00000001:02000400:2.0F:1789438005.767218:0:2965:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg609-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1789438024.093601:0:3187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg609-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1789438026.098361:0:3246:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 607 MB/s 00000001:01000000:3.0:1789438026.348036:0:3246:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 731 MB/s 00000001:01000000:3.0:1789438026.597797:0:3246:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4083 MB/s 00000020:02000000:3.0:1789438027.246844:0:3278:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_g975873d 00000400:02000000:1.0F:1789438028.030827:0:3293:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.206.109@tcp [8/256/0/180] 00008000:02000000:2.0:1789438031.943015:0:3443:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1789438082.677004:0:5244:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg609-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789438094.077553:0:5818:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789438094.077558:0:5818:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1789438094.077861:0:5818:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000004e50ff37 00000080:02000400:0.0:1789438094.078066:0:5818:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1789438094.084665:0:5818:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1789438094.084678:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789438094.084747:0:5818:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000687b7926) 00000020:00000080:0.0:1789438094.084767:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789438094.117838:0:5818:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789438094.118254:0:5818:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1789438094.156237:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1789438094.156273:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789438094.156292:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1789438094.156339:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789438094.156365:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789438094.157925:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789438094.157946:0:5818:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789438094.157957:0:5818:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7a8dd0fcbb9249ae 00000020:01000004:2.0:1789438094.157966:0:5818:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789438094.157971:0:5818:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789438094.157976:0:5818:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004e50ff37 from MGS 00000020:01000004:2.0:1789438094.157980:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789438094.158002:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000002758c28e) 00000020:00000080:2.0:1789438094.158014:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789438094.158085:0:5818:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004e50ff37 from MGS, refs=2 00080000:01000000:2.0:1789438094.158090:0:5818:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789438094.158095:0:5818:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7a8dd0fcbb9249bc 00000100:00100000:2.0:1789438094.158199:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789438094.158320:0:5818:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789438094.158326:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789438094.159047:0:5818:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789438094.159055:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789438094.159663:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789438094.159849:0:5818:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789438094.159856:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789438094.160455:0:5818:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789438094.160462:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789438094.164085:0:5818:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789438094.164102:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789438094.164876:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438094.164879:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438094.164881:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438094.165327:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438094.165330:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438094.165331:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438094.166005:0:5818:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789438094.168855:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1789438094.416078:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1751 MB/s 00000001:01000000:3.0:1789438094.666507:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2083 MB/s 00000001:01000000:0.0:1789438094.917162:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 298 MB/s 00000001:01000000:3.0:1789438095.181791:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 266 MB/s 00080000:10000000:2.0:1789438095.211940:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:1.0:1789438095.224131:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789438095.245804:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1789438095.245822:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789438095.245825:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1789438095.254291:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789438095.254371:0:5818:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789438095.254428:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1789438095.254682:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789438095.254754:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789438095.255218:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789438095.255372:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789438095.255378:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789438095.256517:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789438095.256526:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789438095.260628:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789438095.260642:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789438095.262261:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789438095.262283:0:5818:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.109@tcp' 00000020:01000004:2.0:1789438095.262285:0:5818:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789438095.262374:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.109@tcp (typ=mgc) 00000020:00000080:2.0:1789438095.262386:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.109@tcp (000000009fca3c38) 00000020:00000080:2.0:1789438095.262402:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789438095.262469:0:5818:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c5ec3b02@MGC192.168.206.109@tcp: add connection 192.168.206.109@tcp at head 00000100:00080000:1.0:1789438095.262672:0:5834:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:2.0:1789438095.262925:0:5818:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.109@tcp-0 is initialized 00000040:01000000:2.0:1789438095.262940:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.109@tcp ctxt 1 is initialized 10000000:01000000:3.0:1789438095.269121:0:5836:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789438095.274653:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.109@tcp (uuid 7073a0da-08cf-42fe-8791-a8c6139408f2) 00000020:00000080:0.0:1789438095.275287:0:5818:0:(genops.c:1384:class_connect()) connect: client 7073a0da-08cf-42fe-8791-a8c6139408f2, cookie 0x7a8dd0fcbb9249ca 00000100:00080000:0.0:1789438095.275300:0:5818:0:(import.c:545:import_select_connection()) MGC192.168.206.109@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789438095.275311:0:5818:0:(import.c:666:import_select_connection()) MGC192.168.206.109@tcp: import 00000000c5ec3b02 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:0.0:1789438095.275358:0:5818:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000020730864 x1876361769648256/t0(0) o250->MGC192.168.206.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789438095.275386:0:5818:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 7073a0da-08cf-42fe-8791-a8c6139408f2->MGS 00000020:01000004:0.0:1789438095.275438:0:5818:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789438095.275444:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789438095.275456:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000f7140c1e) 00000020:00000080:0.0:1789438095.275467:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789438095.276034:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000020730864 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7073a0da-08cf-42fe-8791-a8c6139408f2:3308:1876361769648256:0@lo:250: 00000100:00100000:1.0:1789438095.276129:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438095.276210:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769648256 00000100:00100000:1.0:1789438095.276217:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769648256 00000100:00100000:1.0:1789438095.276253:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789438095.276259:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006798bfdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3308:x1876361769648256:12345-0@lo:250: 00010000:00080000:1.0:1789438095.276279:0:5831:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 7073a0da-08cf-42fe-8791-a8c6139408f2@0@lo t0 exp 0000000000000000 cur 147 last 0 00000020:00000080:1.0:1789438095.276299:0:5831:0:(genops.c:1384:class_connect()) connect: client 7073a0da-08cf-42fe-8791-a8c6139408f2, cookie 0x7a8dd0fcbb9249d8 00000100:00080000:1.0:1789438095.276418:0:5831:0:(import.c:65:import_set_state_nolock()) 0000000052642c06 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789438095.276463:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006798bfdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+5:3308:x1876361769648256:12345-0@lo:250: Request processed in 204us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438095.276469:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789438095.276513:0:3308:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.109@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789438095.276520:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.206.109@tcp: connect to target with instance 0 00000100:00080000:1.0:1789438095.276526:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.206.109@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789438095.276529:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789438095.276531:0:3308:0:(import.c:65:import_set_state_nolock()) 00000000c5ec3b02 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789438095.276534:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789438095.276543:0:3308:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789438095.276553:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000020730864 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7073a0da-08cf-42fe-8791-a8c6139408f2:3308:1876361769648256:0@lo:250: 00000100:00100000:1.0:1789438095.296602:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789438095.298179:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789438095.298187:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789438095.300588:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789438095.300602:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789438095.304596:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789438095.304617:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789438095.310909:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789438095.311267:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789438095.311283:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789438095.317585:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789438095.317599:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789438095.395695:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789438095.395973:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789438095.395980:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789438095.400399:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789438095.400415:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789438095.403355:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789438095.403538:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789438095.403545:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789438095.411781:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789438095.411794:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789438095.413645:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789438095.413877:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789438095.413884:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789438095.417441:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789438095.417459:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789438095.433161:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789438095.433346:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789438095.433352:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789438095.434097:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789438095.434105:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789438095.451893:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789438095.453426:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789438095.453450:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789438095.455229:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789438095.455241:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789438095.456341:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789438095.456351:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789438095.457080:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789438095.457127:0:5818:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1789438095.457133:0:5818:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.109@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789438095.457273:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.109@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789438095.457311:0:5818:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.109@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1789438095.457315:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789438095.457317:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789438095.457319:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789438095.457320:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789438095.457321:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789438095.457323:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789438095.457324:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789438095.457325:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789438095.457326:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789438095.457328:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789438095.457333:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789438095.457335:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789438095.457337:0:5818:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1789438095.457339:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789438095.457340:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789438095.457341:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789438095.457342:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789438095.457343:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789438095.457344:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789438095.457344:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789438095.457345:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789438095.457346:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789438095.457347:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789438095.457347:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789438095.457348:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789438095.457380:0:5818:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789438095.457396:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a9a6b92e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769648384:0@lo:253: 00000100:00100000:1.0:1789438095.457464:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438095.457629:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dc84c435 going to sleep for 11 seconds 00000100:00100000:0.0:1789438095.457904:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769648384 00000100:00100000:0.0:1789438095.457911:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769648384 00000100:00100000:0.0:1789438095.458005:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789438095.458012:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e9341cdc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+5:5818:x1876361769648384:12345-0@lo:253: 20000000:01000000:0.0:1789438095.458057:0:5833:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789438095.458059:0:5833:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1789438095.458335:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789438095.458389:0:5833:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1789438095.458751:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789438095.459552:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1789438095.459948:0:5833:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789438095.459954:0:5833:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1789438095.459959:0:5833:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1789438095.459963:0:5833:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1789438095.459978:0:5833:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1789438095.460146:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789438095.460378:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1789438095.460391:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789438095.460440:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1789438095.460491:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1789438095.460530:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1789438095.460872:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1789438095.460883:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1789438095.460947:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1789438095.460955:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1789438095.460988:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1789438095.460995:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1789438095.461026:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1789438095.461091:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1789438095.461123:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789438095.461128:0:5833:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1789438095.461143:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789438095.461340:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1789438095.461350:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789438095.461382:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1789438095.461417:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1789438095.461475:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1789438095.461486:0:5833:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1789438095.461559:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1789438095.461567:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789438095.461607:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1789438095.461640:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1789438095.462020:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1789438095.462034:0:5833:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1789438095.462134:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1789438095.462143:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1789438095.462176:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1789438095.462211:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1789438095.462376:0:5833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1789438095.462424:0:5833:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789438095.462432:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1789438095.463030:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1789438095.463327:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1789438095.463350:0:5833:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.109@tcp for mdt 20000000:01000000:1.0:1789438095.463352:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.109@tcp (null) (null) (null) 00000040:00080000:1.0:1789438095.463387:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1789438095.463395:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789438095.463426:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1789438095.463433:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.109@tcp (null) (null) 00000040:00080000:1.0:1789438095.463478:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1789438095.463490:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789438095.463523:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1789438095.463558:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1789438095.463613:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789438095.463616:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789438095.463621:0:5833:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789438095.463633:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789438095.463642:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789438095.463672:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789438095.463675:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789438095.464301:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1789438095.464566:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1789438095.464612:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1789438095.464648:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1789438095.464670:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789438095.464672:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789438095.465153:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1789438095.465347:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1789438095.465386:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1789438095.465444:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1789438095.465458:0:5833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789438095.465461:0:5833:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1789438095.465466:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789438095.465468:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789438095.465473:0:5833:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789438095.465480:0:5833:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789438095.465892:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1789438095.466007:0:5833:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1789438095.474490:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1789438095.474543:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1789438095.474617:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1789438095.474642:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789438095.474662:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000083cb93e4/0x7a8dd0fcbb9249df lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438095.474678:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000083cb93e4/0x7a8dd0fcbb9249df lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438095.474688:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000083cb93e4/0x7a8dd0fcbb9249df lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438095.474694:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000083cb93e4/0x7a8dd0fcbb9249df lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438095.474699:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000083cb93e4/0x7a8dd0fcbb9249df lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438095.475640:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000083cb93e4/0x7a8dd0fcbb9249df lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438095.475646:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000083cb93e4 already unused, calling callback (000000000b527ec0) 00010000:00010000:2.0:1789438095.475650:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000083cb93e4/0x7a8dd0fcbb9249df lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438095.475657:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000083cb93e4/0x7a8dd0fcbb9249df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438095.475670:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000083cb93e4/0x7a8dd0fcbb9249df lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438095.475678:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000083cb93e4/0x7a8dd0fcbb9249df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438095.475683:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000083cb93e4/0x7a8dd0fcbb9249df lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789438095.475700:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789438095.595259:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e9341cdc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+5:5818:x1876361769648384:12345-0@lo:253: Request processed in 137241us (137788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438095.595274:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789438095.595357:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a9a6b92e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769648384:0@lo:253: 10000000:01000000:2.0:1789438095.595372:0:5818:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789438095.595375:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789438095.595376:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789438095.595378:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789438095.595379:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1789438095.595381:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789438095.595382:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789438095.595383:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789438095.595384:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789438095.595385:0:5818:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789438095.595398:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789438095.595400:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789438095.595416:0:5818:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004e50ff37 from lustre-MDT0000 10000000:01000000:2.0:1789438095.595441:0:5818:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789438095.595443:0:5818:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789438095.595447:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9991e1e54d40 10000000:01000000:2.0:1789438095.595451:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789438095.595458:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9991e1e54d40 from 1 10000000:01000000:2.0:1789438095.595460:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789438095.595511:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: 0000000083cb93e4/0x7a8dd0fcbb9249e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438095.595521:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: 0000000083cb93e4/0x7a8dd0fcbb9249e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438095.595528:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: 0000000083cb93e4/0x7a8dd0fcbb9249e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438095.595542:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e07b91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769648512:0@lo:101: 00000100:00100000:2.0:1789438095.595651:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438095.595877:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 0000000068fc0abb going to sleep for 11 seconds 00000100:00100000:3.0:1789438095.596288:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769648512 00000100:00100000:3.0:1789438095.596297:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769648512 00000100:00100000:3.0:1789438095.596390:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789438095.596398:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cd20b065 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+5:5818:x1876361769648512:12345-0@lo:101: 00010000:00010000:3.0:1789438095.596410:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438095.596423:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ed2d616f/0x7a8dd0fcbb9249ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb9249e6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438095.596444:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ed2d616f/0x7a8dd0fcbb9249ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb9249e6 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438095.596453:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ed2d616f/0x7a8dd0fcbb9249ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb9249e6 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438095.596460:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ed2d616f, rc 0) 00000100:00100000:3.0:1789438095.596514:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cd20b065 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+6:5818:x1876361769648512:12345-0@lo:101: Request processed in 118us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438095.596521:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789438095.596598:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e07b91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769648512:0@lo:101: 00010000:00010000:2.0:1789438095.596611:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: 0000000083cb93e4/0x7a8dd0fcbb9249e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb9249ed expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438095.596619:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: 0000000083cb93e4/0x7a8dd0fcbb9249e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb9249ed expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438095.596685:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e07b91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769648640:0@lo:501: 00000100:00100000:2.0:1789438095.596741:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438095.597036:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 0000000068fc0abb going to sleep for 11 seconds 00000100:00100000:1.0:1789438095.597110:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769648640 00000100:00100000:1.0:1789438095.597116:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769648640 00000100:00100000:1.0:1789438095.597140:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789438095.597146:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ec3938ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+6:5818:x1876361769648640:12345-0@lo:501: 00000100:00100000:1.0:1789438095.597375:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ec3938ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+6:5818:x1876361769648640:12345-0@lo:501: Request processed in 228us (634us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789438095.597383:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789438095.597702:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e07b91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769648640:0@lo:501: 10000000:01000000:2.0:1789438095.597761:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789438095.597773:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: 0000000083cb93e4/0x7a8dd0fcbb9249e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb9249ed expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438095.597782:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: 0000000083cb93e4/0x7a8dd0fcbb9249e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb9249ed expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789438095.597791:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9991d197a000 10000000:01000000:2.0:1789438095.597795:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789438095.597799:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9991d197a000 10000000:01000000:2.0:1789438095.597801:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789438095.597804:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9991d197a000 from 1 10000000:01000000:2.0:1789438095.597806:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789438095.597828:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: 000000009a0ff867/0x7a8dd0fcbb9249f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438095.597836:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: 000000009a0ff867/0x7a8dd0fcbb9249f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438095.597843:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: 000000009a0ff867/0x7a8dd0fcbb9249f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438095.597868:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e07b91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769648768:0@lo:101: 00000100:00100000:2.0:1789438095.597899:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438095.597920:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 0000000068fc0abb going to sleep for 11 seconds 00000100:00100000:1.0:1789438095.598082:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769648768 00000100:00100000:1.0:1789438095.598088:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769648768 00000100:00100000:1.0:1789438095.598108:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789438095.598112:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000062da51ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+6:5818:x1876361769648768:12345-0@lo:101: 00010000:00010000:1.0:1789438095.598121:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438095.598132:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000389fe60e/0x7a8dd0fcbb9249fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb9249f4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438095.598149:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000389fe60e/0x7a8dd0fcbb9249fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb9249f4 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438095.598157:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000389fe60e/0x7a8dd0fcbb9249fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb9249f4 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438095.598165:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000389fe60e, rc 0) 00000100:00100000:1.0:1789438095.598202:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000062da51ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+7:5818:x1876361769648768:12345-0@lo:101: Request processed in 89us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438095.598208:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789438095.598280:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e07b91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769648768:0@lo:101: 00010000:00010000:2.0:1789438095.598289:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: 000000009a0ff867/0x7a8dd0fcbb9249f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb9249fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438095.598304:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: 000000009a0ff867/0x7a8dd0fcbb9249f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb9249fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789438095.598316:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789438095.598330:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: 000000009a0ff867/0x7a8dd0fcbb9249f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb9249fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438095.598336:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: 000000009a0ff867/0x7a8dd0fcbb9249f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb9249fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789438095.598342:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789438095.598345:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789438095.598349:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9991d197a000 10000000:01000000:2.0:1789438095.598351:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789438095.598354:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789438095.598356:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789438095.598368:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: 00000000796e1f3e/0x7a8dd0fcbb924a02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438095.598373:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: 00000000796e1f3e/0x7a8dd0fcbb924a02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438095.598379:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: 00000000796e1f3e/0x7a8dd0fcbb924a02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438095.598389:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e07b91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769648896:0@lo:101: 00000100:00100000:2.0:1789438095.598413:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438095.598423:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 0000000068fc0abb going to sleep for 11 seconds 00000100:00100000:1.0:1789438095.598482:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769648896 00000100:00100000:1.0:1789438095.598487:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769648896 00000100:00100000:1.0:1789438095.598508:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789438095.598513:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000054fa57d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+7:5818:x1876361769648896:12345-0@lo:101: 00010000:00010000:1.0:1789438095.598519:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438095.598525:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002a5795f8/0x7a8dd0fcbb924a09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924a02 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438095.598537:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002a5795f8/0x7a8dd0fcbb924a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924a02 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438095.598545:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002a5795f8/0x7a8dd0fcbb924a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924a02 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438095.598551:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002a5795f8, rc 0) 00000100:00100000:1.0:1789438095.598593:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000054fa57d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+8:5818:x1876361769648896:12345-0@lo:101: Request processed in 79us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438095.598598:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789438095.598779:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e07b91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769648896:0@lo:101: 00010000:00010000:2.0:1789438095.598788:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: 00000000796e1f3e/0x7a8dd0fcbb924a02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924a09 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438095.598795:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: 00000000796e1f3e/0x7a8dd0fcbb924a02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924a09 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438095.598835:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e07b91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769649024:0@lo:501: 00000100:00100000:2.0:1789438095.598941:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438095.598965:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 0000000068fc0abb going to sleep for 11 seconds 00000100:00100000:1.0:1789438095.599014:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769649024 00000100:00100000:1.0:1789438095.599018:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769649024 00000100:00100000:1.0:1789438095.599034:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789438095.599039:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f6041b96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+8:5818:x1876361769649024:12345-0@lo:501: 00000100:00100000:1.0:1789438095.599280:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f6041b96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+9:5818:x1876361769649024:12345-0@lo:501: Request processed in 240us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438095.599287:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789438095.599450:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e07b91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769649024:0@lo:501: 00000100:00100000:2.0:1789438095.599474:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e07b91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769649152:0@lo:503: 00000100:00100000:2.0:1789438095.599508:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438095.599558:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 0000000068fc0abb going to sleep for 11 seconds 00000100:00100000:0.0:1789438095.599655:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769649152 00000100:00100000:0.0:1789438095.599760:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769649152 00000100:00100000:1.0:1789438095.599837:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789438095.599846:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000053885f56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+9:5818:x1876361769649152:12345-0@lo:503: 00000100:00100000:1.0:1789438095.600023:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000053885f56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+9:5818:x1876361769649152:12345-0@lo:503: Request processed in 179us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438095.600029:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789438095.600385:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e07b91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769649152:0@lo:503: 00000100:00100000:2.0:1789438095.600894:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e07b91e pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:5861:1876361769649280:0@lo:502: 00000100:00100000:2.0:1789438095.600950:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438095.600985:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e3c9d78d going to sleep for 11 seconds 00000100:00100000:3.0:1789438095.601040:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769649280 00000100:00100000:3.0:1789438095.601046:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769649280 00000100:00100000:3.0:1789438095.601082:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789438095.601088:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000de274233 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+9:5861:x1876361769649280:12345-0@lo:502: 00000100:00100000:3.0:1789438095.601266:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000de274233 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+9:5861:x1876361769649280:12345-0@lo:502: Request processed in 178us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438095.601273:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789438095.601415:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e07b91e pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:5861:1876361769649280:0@lo:502: 00000020:01000000:2.0:1789438095.601436:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789438095.601446:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789438095.601449:0:5861:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789438095.601453:0:5861:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789438095.601456:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789438095.601468:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000250a8864) 00000020:00000080:2.0:1789438095.601484:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789438095.601495:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789438095.601581:0:5861:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789438095.601588:0:5861:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7a8dd0fcbb924a17 00000020:00000080:2.0:1789438095.601997:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789438095.602002:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789438095.602005:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789438095.602007:0:5861:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789438095.602010:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789438095.602013:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789438095.602015:0:5861:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789438095.602018:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789438095.602025:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000261008ce) 00000020:00000080:2.0:1789438095.602035:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789438095.602038:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789438095.602039:0:5861:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789438095.602041:0:5861:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789438095.602047:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789438095.602096:0:5861:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004e50ff37 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789438095.602113:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000946ce7cd) 00000020:00000080:2.0:1789438095.602121:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789438095.602165:0:5861:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789438095.602169:0:5861:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7a8dd0fcbb924a2c 00000020:00000080:2.0:1789438095.602258:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789438095.602264:0:5861:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789438095.602268:0:5861:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x7a8dd0fcbb924a33 00080000:01000000:2.0:1789438095.602273:0:5861:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789438095.602276:0:5861:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7a8dd0fcbb924a3a 00080000:10000000:2.0:1789438095.602642:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1789438095.603205:0:5861:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1789438095.607112:0:5861:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1789438095.748022:0:5861:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1789438095.748380:0:5861:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1789438095.752367:0:5861:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1789438095.752643:0:5861:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789438095.789350:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000043e21888) 00000020:00000080:0.0:1789438095.789371:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789438095.789432:0:5861:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789438095.789444:0:5861:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7a8dd0fcbb924a48 00000020:00000080:1.0:1789438095.795341:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1789438095.800328:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789438095.844630:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789438095.870307:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789438095.906055:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789438095.995389:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789438096.057650:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1789438096.096466:0:5861:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x7a8dd0fcbb924a4f 00000020:00000080:1.0:1789438096.096767:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789438096.096776:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789438096.096782:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438096.096784:0:5861:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789438096.096787:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789438096.096790:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438096.096791:0:5861:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789438096.096794:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789438096.096795:0:5861:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789438096.096797:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789438096.096799:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438096.096800:0:5861:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789438096.096802:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789438096.096806:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438096.096807:0:5861:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789438096.096811:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789438096.096842:0:5861:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1789438096.097126:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000443d0f53 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:5861:1876361769649408:0@lo:502: 00000100:00100000:1.0:1789438096.097196:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438096.097248:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set 000000002d154243 going to sleep for 11 seconds 00000100:00100000:2.0:1789438096.097344:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769649408 00000100:00100000:2.0:1789438096.097350:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769649408 00000100:00100000:2.0:1789438096.097390:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789438096.097402:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c1b10a15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+9:5861:x1876361769649408:12345-0@lo:502: 00000100:00100000:2.0:1789438096.097886:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c1b10a15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+9:5861:x1876361769649408:12345-0@lo:502: Request processed in 484us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438096.097894:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789438096.098178:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000443d0f53 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:5861:1876361769649408:0@lo:502: 00000020:01000000:3.0:1789438096.098202:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789438096.098207:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789438096.098208:0:5861:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1789438096.098213:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1789438096.098479:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1789438096.098499:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789438096.098551:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: 00000000796e1f3e/0x7a8dd0fcbb924a02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924a09 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438096.098562:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: 00000000796e1f3e/0x7a8dd0fcbb924a02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924a09 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789438096.098571:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9991d197a000 from 1 10000000:01000000:2.0:1789438096.098573:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789438096.098597:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: 00000000aa664945/0x7a8dd0fcbb924a56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438096.098604:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: 00000000aa664945/0x7a8dd0fcbb924a56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438096.098611:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: 00000000aa664945/0x7a8dd0fcbb924a56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438096.098625:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e07b91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769649536:0@lo:101: 00000100:00100000:2.0:1789438096.098655:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438096.098686:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da0ca34c going to sleep for 11 seconds 00000100:00100000:3.0:1789438096.102180:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769649536 00000100:00100000:3.0:1789438096.102193:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769649536 00000100:00100000:3.0:1789438096.102241:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789438096.102247:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006f6faa9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+9:5818:x1876361769649536:12345-0@lo:101: 00010000:00010000:3.0:1789438096.102261:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438096.102277:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000be4afcdb/0x7a8dd0fcbb924a5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924a56 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438096.102300:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000be4afcdb/0x7a8dd0fcbb924a5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924a56 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438096.102309:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000be4afcdb/0x7a8dd0fcbb924a5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924a56 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438096.102330:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000be4afcdb, rc 0) 00000100:00100000:3.0:1789438096.102388:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006f6faa9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+10:5818:x1876361769649536:12345-0@lo:101: Request processed in 141us (3732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438096.102394:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789438096.102600:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e07b91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769649536:0@lo:101: 00010000:00010000:2.0:1789438096.102616:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: 00000000aa664945/0x7a8dd0fcbb924a56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924a5d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438096.102630:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: 00000000aa664945/0x7a8dd0fcbb924a56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924a5d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438096.103197:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e07b91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769649664:0@lo:256: 00000100:00100000:2.0:1789438096.103240:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438096.103279:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da0ca34c going to sleep for 11 seconds 00000100:00100000:1.0:1789438096.103454:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769649664 00000100:00100000:1.0:1789438096.103460:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769649664 00000100:00100000:1.0:1789438096.103488:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789438096.103494:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c52b9820 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+10:5818:x1876361769649664:12345-0@lo:256: 20000000:01000000:1.0:1789438096.103507:0:5831:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789438096.103512:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789438096.103575:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c52b9820 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+10:5818:x1876361769649664:12345-0@lo:256: Request processed in 81us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438096.103588:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789438096.104133:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e07b91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769649664:0@lo:256: 10000000:01000000:2.0:1789438096.104649:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789438096.105299:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: 00000000aa664945/0x7a8dd0fcbb924a56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924a5d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438096.105313:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: 00000000aa664945/0x7a8dd0fcbb924a56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924a5d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789438096.105321:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9991d197a000 from 1 10000000:01000000:2.0:1789438096.105324:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789438096.105353:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: 00000000a44f6957/0x7a8dd0fcbb924a64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438096.105360:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: 00000000a44f6957/0x7a8dd0fcbb924a64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438096.105368:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: 00000000a44f6957/0x7a8dd0fcbb924a64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438096.105382:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e07b91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769649792:0@lo:101: 00000100:00100000:2.0:1789438096.105425:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438096.105467:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da0ca34c going to sleep for 11 seconds 00000100:00100000:3.0:1789438096.105541:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769649792 00000100:00100000:3.0:1789438096.105547:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769649792 00000100:00100000:3.0:1789438096.105581:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789438096.105587:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f6469bb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+10:5818:x1876361769649792:12345-0@lo:101: 00010000:00010000:3.0:1789438096.105597:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438096.105606:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000eb3a785b/0x7a8dd0fcbb924a6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924a64 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438096.105624:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eb3a785b/0x7a8dd0fcbb924a6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924a64 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438096.105632:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000eb3a785b/0x7a8dd0fcbb924a6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924a64 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438096.105639:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000eb3a785b, rc 0) 00000100:00100000:3.0:1789438096.105672:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f6469bb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+11:5818:x1876361769649792:12345-0@lo:101: Request processed in 85us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438096.105677:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789438096.105997:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e07b91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769649792:0@lo:101: 00010000:00010000:2.0:1789438096.106008:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: 00000000a44f6957/0x7a8dd0fcbb924a64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924a6b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438096.106016:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: 00000000a44f6957/0x7a8dd0fcbb924a64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924a6b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438096.106058:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e07b91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769649920:0@lo:501: 00000100:00100000:2.0:1789438096.106080:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438096.106104:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da0ca34c going to sleep for 11 seconds 00000100:00100000:0.0:1789438096.106152:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769649920 00000100:00100000:0.0:1789438096.106156:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769649920 00000100:00100000:0.0:1789438096.106184:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789438096.106189:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009849198f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+11:5818:x1876361769649920:12345-0@lo:501: 00000100:00100000:0.0:1789438096.106671:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009849198f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+11:5818:x1876361769649920:12345-0@lo:501: Request processed in 481us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438096.106678:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789438096.106968:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e07b91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769649920:0@lo:501: 00000100:00100000:2.0:1789438096.106995:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e07b91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769650048:0@lo:503: 00000100:00100000:2.0:1789438096.107032:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438096.107057:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da0ca34c going to sleep for 11 seconds 00000100:00100000:1.0:1789438096.107104:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769650048 00000100:00100000:1.0:1789438096.107108:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769650048 00000100:00100000:1.0:1789438096.107135:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789438096.107141:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001b130ce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+11:5818:x1876361769650048:12345-0@lo:503: 00000040:00080000:1.0:1789438096.107169:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789438096.107206:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001b130ce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+11:5818:x1876361769650048:12345-0@lo:503: Request processed in 66us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438096.107212:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789438096.107297:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e07b91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769650048:0@lo:503: 00000040:00080000:0.0:1789438096.108396:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789438096.108556:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789438096.108572:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789438096.108586:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: 00000000a44f6957/0x7a8dd0fcbb924a64 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924a6b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438096.108597:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: 00000000a44f6957/0x7a8dd0fcbb924a64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924a6b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789438096.108635:0:5818:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789438096.108637:0:5818:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9991d197a000 10000000:01000000:2.0:1789438096.108640:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9991d197a000 10000000:01000000:2.0:1789438096.108643:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789438096.108656:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9991d197a000 from 1 10000000:01000000:2.0:1789438096.108658:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789438096.108683:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: 0000000070c854b5/0x7a8dd0fcbb924a72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438096.108690:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: 0000000070c854b5/0x7a8dd0fcbb924a72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438096.108698:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: 0000000070c854b5/0x7a8dd0fcbb924a72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438096.109058:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e07b91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769650176:0@lo:101: 00000100:00100000:2.0:1789438096.109102:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438096.109176:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da0ca34c going to sleep for 11 seconds 00000100:00100000:1.0:1789438096.111122:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769650176 00000100:00100000:1.0:1789438096.111134:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769650176 00000100:00100000:1.0:1789438096.111189:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789438096.111196:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b97b1bbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+11:5818:x1876361769650176:12345-0@lo:101: 00010000:00010000:1.0:1789438096.111210:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438096.111224:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007caa4828/0x7a8dd0fcbb924a79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924a72 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438096.111247:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007caa4828/0x7a8dd0fcbb924a79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924a72 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438096.111256:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007caa4828/0x7a8dd0fcbb924a79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924a72 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438096.111264:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007caa4828, rc 0) 00000100:00100000:1.0:1789438096.111331:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b97b1bbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:5818:x1876361769650176:12345-0@lo:101: Request processed in 136us (2230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438096.111337:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789438096.111431:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e07b91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769650176:0@lo:101: 00010000:00010000:3.0:1789438096.111445:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: 0000000070c854b5/0x7a8dd0fcbb924a72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924a79 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438096.111454:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: 0000000070c854b5/0x7a8dd0fcbb924a72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924a79 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438096.111530:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db9302e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769650304:0@lo:501: 00000100:00100000:3.0:1789438096.111558:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438096.111590:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e508c4d going to sleep for 11 seconds 00000100:00100000:2.0:1789438096.111631:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769650304 00000100:00100000:2.0:1789438096.111635:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769650304 00000100:00100000:2.0:1789438096.111668:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789438096.111673:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000407f0c21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+12:5818:x1876361769650304:12345-0@lo:501: 00000100:00100000:2.0:1789438096.112174:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000407f0c21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+12:5818:x1876361769650304:12345-0@lo:501: Request processed in 500us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438096.112182:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789438096.112239:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db9302e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769650304:0@lo:501: 00000100:00100000:3.0:1789438096.112266:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db9302e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769650432:0@lo:503: 00000100:00100000:3.0:1789438096.112299:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438096.112324:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e508c4d going to sleep for 11 seconds 00000100:00100000:0.0:1789438096.112380:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769650432 00000100:00100000:0.0:1789438096.112384:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769650432 00000100:00100000:0.0:1789438096.112403:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789438096.112407:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000983efa13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+12:5818:x1876361769650432:12345-0@lo:503: 00000100:00100000:0.0:1789438096.112683:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000983efa13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+12:5818:x1876361769650432:12345-0@lo:503: Request processed in 275us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438096.112690:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789438096.112780:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db9302e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769650432:0@lo:503: 00000100:00100000:3.0:1789438096.113449:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db9302e3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:5866:1876361769650560:0@lo:502: 00000100:00100000:3.0:1789438096.113486:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438096.113514:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set 000000008650d6db going to sleep for 11 seconds 00000100:00100000:0.0:1789438096.113548:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769650560 00000100:00100000:0.0:1789438096.113552:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769650560 00000100:00100000:0.0:1789438096.113578:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789438096.113584:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ea7a0f71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+12:5866:x1876361769650560:12345-0@lo:502: 00000100:00100000:3.0:1789438096.114290:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ea7a0f71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+12:5866:x1876361769650560:12345-0@lo:502: Request processed in 704us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438096.114298:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789438096.114375:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db9302e3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:5866:1876361769650560:0@lo:502: 00000020:01000004:0.0:1789438096.114424:0:5866:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789438096.114437:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000e927a5ac) 00000020:00000080:0.0:1789438096.114455:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1789438096.114525:0:5866:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004e50ff37 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789438096.114528:0:5866:0:(tgt_mount.c:187:server_put_mount()) put mount 000000004e50ff37 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789438096.114534:0:5866:0:(obd_mount.c:710:lustre_put_lsi()) put 000000004e50ff37 4 00010000:00080000:0.0:1789438096.114557:0:5866:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b8a3dcda@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.109@tcp at head 00010000:00010000:0.0:1789438096.116194:0:5866:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1789438096.116381:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789438096.116414:0:5866:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789438096.116424:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x7a8dd0fcbb924a87 00000100:00080000:0.0:1789438096.116432:0:5866:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789438096.116441:0:5866:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b8a3dcda using connection 192.168.206.109@tcp/0@lo 00000100:00100000:0.0:1789438096.116468:0:5866:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e22922a5 x1876361769650688/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789438096.116483:0:5866:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789438096.118490:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e22922a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876361769650688:0@lo:38: 00000100:00100000:1.0:1789438096.118578:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438096.118699:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769650688 00000100:00100000:3.0:1789438096.118730:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769650688 00000100:00100000:3.0:1789438096.118772:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789438096.118777:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003d139373 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1876361769650688:12345-0@lo:38: 00000100:00100000:3.0:1789438096.118837:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003d139373 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1876361769650688:12345-0@lo:38: Request processed in 59us (260us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789438096.118843:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789438096.118875:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789438096.118880:0:3308:0:(import.c:65:import_set_state_nolock()) 00000000b8a3dcda lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789438096.118884:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789438096.118887:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e22922a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876361769650688:0@lo:38: 00000100:00100000:2.0:1789438096.119093:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec7e0997 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:5866:1876361769650816:0@lo:502: 00000100:00100000:2.0:1789438096.119131:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438096.119153:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769650816 00000100:00100000:2.0:1789438096.119157:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769650816 00000100:00100000:2.0:1789438096.119181:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789438096.119185:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000086f5e8df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:5866:x1876361769650816:12345-0@lo:502: 00000100:00100000:2.0:1789438096.119358:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000086f5e8df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:5866:x1876361769650816:12345-0@lo:502: Request processed in 172us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438096.119369:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789438096.119407:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eb7960c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789438096.119417:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec7e0997 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:5866:1876361769650816:0@lo:502: 00000040:00080000:2.0:1789438096.119435:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1789438096.119492:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1789438096.119507:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789438096.119518:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: 0000000070c854b5/0x7a8dd0fcbb924a72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924a79 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438096.119528:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: 0000000070c854b5/0x7a8dd0fcbb924a72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924a79 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789438096.119562:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789438096.119564:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789438096.119565:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789438096.119567:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789438096.119568:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789438096.119569:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789438096.119570:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789438096.119572:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789438096.119573:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789438096.119574:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789438096.119575:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789438096.119576:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789438096.119579:0:5818:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1789438096.119581:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789438096.119582:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789438096.119583:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789438096.119584:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789438096.119585:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789438096.119587:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789438096.119588:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789438096.119589:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789438096.119590:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789438096.119593:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789438096.119594:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789438096.119595:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789438096.119605:0:5818:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789438096.119612:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec7e0997 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769650944:0@lo:253: 00000100:00100000:2.0:1789438096.119636:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438096.119645:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ddbdca72 going to sleep for 11 seconds 00000100:00100000:3.0:1789438096.119970:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769650944 00000100:00100000:3.0:1789438096.119976:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769650944 00000100:00100000:3.0:1789438096.120000:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789438096.120005:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d4ac23a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+12:5818:x1876361769650944:12345-0@lo:253: 20000000:01000000:3.0:1789438096.120024:0:5833:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789438096.120036:0:5833:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789438096.164758:0:5833:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789438096.164779:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789438096.164844:0:5854:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789438096.164849:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789438096.164889:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a8993ea9/0x7a8dd0fcbb924a8e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438096.164911:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000be4afcdb/0x7a8dd0fcbb924a5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924a56 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438096.164920:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a8993ea9/0x7a8dd0fcbb924a8e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438096.164971:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000be4afcdb/0x7a8dd0fcbb924a5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb924a56 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438096.164986:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000be4afcdb/0x7a8dd0fcbb924a5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924a56 expref: 12 pid: 5833 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438096.165001:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ac5c0134 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1876361769651072:0@lo:104: 00000100:00100000:0.0:1789438096.165069:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438096.165147:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c20782a4 going to sleep for 11 seconds 00000100:00100000:2.0:1789438096.165375:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769651072 00000100:00100000:2.0:1789438096.165383:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769651072 00000100:00100000:2.0:1789438096.165433:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789438096.165441:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009d409497 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+3:5854:x1876361769651072:12345-0@lo:104: 00010000:00010000:2.0:1789438096.165453:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: 00000000aa664945/0x7a8dd0fcbb924a56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924a5d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438096.165504:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789438096.165508:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009d409497 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+3:5854:x1876361769651072:12345-0@lo:104: Request processed in 70us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438096.165515:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789438096.165537:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789438096.165542:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: 00000000aa664945/0x7a8dd0fcbb924a56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924a5d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438096.165548:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000aa664945 already unused, calling callback (000000008b6d47a5) 10000000:00010000:2.0:1789438096.165551:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: 00000000aa664945/0x7a8dd0fcbb924a56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb924a5d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438096.165558:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: 00000000aa664945/0x7a8dd0fcbb924a56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb924a5d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789438096.165575:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: 00000000aa664945/0x7a8dd0fcbb924a56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb924a5d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789438096.165581:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789438096.165607:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: 00000000aa664945/0x7a8dd0fcbb924a56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924a5d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438096.165614:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789438096.165625:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: 00000000aa664945/0x7a8dd0fcbb924a56 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924a5d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438096.165631:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: 00000000aa664945/0x7a8dd0fcbb924a56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924a5d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438096.165644:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438096.165646:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438096.165647:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438096.165675:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ac5c0134 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1876361769651072:0@lo:104: 00010000:00010000:2.0:1789438096.165690:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a8993ea9/0x7a8dd0fcbb924a8e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438096.166208:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050d3e05f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769651200:0@lo:103: 00000100:00100000:3.0:1789438096.166246:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438096.167148:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769651200 00000100:00100000:0.0:1789438096.167158:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769651200 00010000:00010000:0.0:1789438096.167186:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000be4afcdb/0x7a8dd0fcbb924a5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924a56 expref: 13 pid: 5833 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438096.167214:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789438096.167221:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002be3d973 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+13:3310:x1876361769651200:12345-0@lo:103: 00010000:00010000:0.0:1789438096.167233:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438096.167237:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000be4afcdb/0x7a8dd0fcbb924a5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924a56 expref: 13 pid: 5833 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438096.167247:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000be4afcdb/0x7a8dd0fcbb924a5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924a56 expref: 13 pid: 5833 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438096.167261:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000be4afcdb/0x7a8dd0fcbb924a5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb924a56 expref: 13 pid: 5833 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438096.167274:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a8993ea9/0x7a8dd0fcbb924a8e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438096.167282:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a8993ea9/0x7a8dd0fcbb924a8e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789438096.167296:0:5822:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002447297s 00010000:00010000:0.0:1789438096.167299:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a8993ea9/0x7a8dd0fcbb924a8e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438096.167306:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a8993ea9/0x7a8dd0fcbb924a8e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438096.167311:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a8993ea9/0x7a8dd0fcbb924a8e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438096.167328:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a8993ea9/0x7a8dd0fcbb924a8e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438096.167334:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a8993ea9 already unused, calling callback (000000000b527ec0) 00010000:00010000:0.0:1789438096.167337:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a8993ea9/0x7a8dd0fcbb924a8e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438096.167344:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a8993ea9/0x7a8dd0fcbb924a8e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438096.167354:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a8993ea9/0x7a8dd0fcbb924a8e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438096.167364:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438096.167409:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002be3d973 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+12:3310:x1876361769651200:12345-0@lo:103: Request processed in 189us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438096.167417:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789438096.167493:0:5854:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a8993ea9/0x7a8dd0fcbb924a8e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438096.167501:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a8993ea9/0x7a8dd0fcbb924a8e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438096.167506:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a8993ea9/0x7a8dd0fcbb924a8e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438096.167595:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050d3e05f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769651200:0@lo:103: 00000100:00100000:3.0:1789438096.182062:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d4ac23a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+11:5818:x1876361769650944:12345-0@lo:253: Request processed in 62048us (62417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438096.182078:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789438096.182391:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec7e0997 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:5818:1876361769650944:0@lo:253: 10000000:01000000:2.0:1789438096.182406:0:5818:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789438096.182409:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789438096.182411:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789438096.182412:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789438096.182414:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789438096.182415:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789438096.182416:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789438096.182417:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789438096.182419:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789438096.182420:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789438096.182422:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789438096.182423:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789438096.182424:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789438096.182439:0:5818:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789438096.195773:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789438096.196168:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789438096.196388:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789438096.196572:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789438096.197064:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789438096.197253:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789438096.198478:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789438096.198649:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789438096.198890:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789438096.199072:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789438096.199306:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789438096.199475:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1789438096.247573:0:5818:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00010000:00010000:2.0:1789438096.250498:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789438096.283648:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1789438096.284016:0:5872:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:2.0:1789438096.285226:0:5871:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1789438096.285231:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789438096.287839:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789438096.288082:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789438096.288661:0:5818:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789438096.288670:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789438096.288861:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789438096.289948:0:5818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789438096.290587:0:5818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789438096.290623:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789438096.290856:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789438096.291043:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1789438096.292486:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1789438096.292631:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1789438096.292796:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789438096.292950:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1789438096.293103:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789438096.293232:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1789438096.293479:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1789438096.293611:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1789438096.293773:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789438096.294044:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789438096.294238:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789438096.294375:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789438096.294509:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789438096.294633:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789438096.294991:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789438096.295127:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789438096.295425:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789438096.295550:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789438096.295680:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1789438096.299264:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1789438096.299453:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1789438096.299592:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1789438096.301756:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1789438096.301991:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1789438096.302134:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1789438096.302288:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1789438096.302418:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1789438096.302559:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1789438096.302678:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1789438096.302850:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1789438096.303015:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789438096.303187:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789438096.303361:0:5818:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1789438096.342005:0:5872:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1789438096.402504:0:5818:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789438096.402538:0:5818:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaf4fc166b988 00100000:10000000:3.0:1789438096.402545:0:5818:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789438096.404471:0:5818:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789438096.404487:0:5818:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.109@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789438096.404501:0:5818:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789438096.404528:0:5818:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1789438096.406378:0:5872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789438096.406439:0:5872:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789438096.406444:0:5872:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1789438097.273111:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438098.298350:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438099.321231:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438100.344796:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789438101.217383:0:6114:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg609-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1789438101.303860:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789438101.303870:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789438101.303873:0:37:0:(import.c:65:import_set_state_nolock()) 00000000b8a3dcda lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789438101.303889:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b8a3dcda using connection 192.168.206.109@tcp/0@lo 00000100:00100000:3.0:1789438101.303920:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000590822fa x1876361769651456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789438101.304150:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000590822fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876361769651456:0@lo:38: 00000100:00100000:0.0:1789438101.307039:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b2743495 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769651328:0@lo:400: 00000100:00100000:0.0:1789438101.307113:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438101.307190:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769651328 00000100:00100000:0.0:1789438101.307197:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769651328 00000100:00100000:0.0:1789438101.307231:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789438101.307237:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000039c736aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+11:3311:x1876361769651328:12345-0@lo:400: 00000100:00100000:0.0:1789438101.307281:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000039c736aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+11:3311:x1876361769651328:12345-0@lo:400: Request processed in 45us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438101.307287:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789438101.307344:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b2743495 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769651328:0@lo:400: 00000100:00100000:2.0:1789438101.307494:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438101.308282:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769651456 00000100:00100000:0.0:1789438101.308288:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769651456 00000100:00100000:0.0:1789438101.308328:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789438101.308333:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ec7e0997 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1876361769651456:12345-0@lo:38: 00010000:00080000:0.0:1789438101.308353:0:5840:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 153 last 0 00000020:00000080:0.0:1789438101.308385:0:5840:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x7a8dd0fcbb924a95 00000004:00100000:0.0:1789438101.308418:0:5840:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789438101.308531:0:5840:0:(import.c:65:import_set_state_nolock()) 0000000011fdf51e : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789438101.308585:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ec7e0997 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876361769651456:12345-0@lo:38: Request processed in 252us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438101.308592:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789438101.308966:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000590822fa x1876361769651456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789438111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789438101.308981:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789438101.308987:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789438101.308997:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789438101.308999:0:3308:0:(import.c:65:import_set_state_nolock()) 00000000b8a3dcda lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789438101.309004:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000590822fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876361769651456:0@lo:38: 00010000:00010000:1.0:1789438101.366826:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789438101.816411:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789438101.816420:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9991d197a000 from 3 10000000:01000000:2.0:1789438101.816425:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789438101.816470:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: 0000000011559c5f/0x7a8dd0fcbb924a9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438101.816482:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: 0000000011559c5f/0x7a8dd0fcbb924a9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438101.816492:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: 0000000011559c5f/0x7a8dd0fcbb924a9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438101.816514:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002e058ca8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769651584:0@lo:101: 00000100:00100000:2.0:1789438101.816580:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438101.816644:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d738e4e0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438101.817103:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769651584 00000100:00100000:3.0:1789438101.817111:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769651584 00000100:00100000:3.0:1789438101.817169:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789438101.817177:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005fc2c2b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+11:5836:x1876361769651584:12345-0@lo:101: 00010000:00010000:3.0:1789438101.817190:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438101.817204:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000939b6e06/0x7a8dd0fcbb924aa3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924a9c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438101.817232:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000939b6e06/0x7a8dd0fcbb924aa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924a9c expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438101.817242:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000939b6e06/0x7a8dd0fcbb924aa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924a9c expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438101.817251:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000939b6e06, rc 0) 00000100:00100000:3.0:1789438101.817413:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005fc2c2b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+12:5836:x1876361769651584:12345-0@lo:101: Request processed in 236us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438101.817421:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789438101.817502:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002e058ca8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769651584:0@lo:101: 00010000:00010000:1.0:1789438101.817518:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: 0000000011559c5f/0x7a8dd0fcbb924a9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924aa3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438101.817542:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: 0000000011559c5f/0x7a8dd0fcbb924a9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924aa3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438101.817589:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002fa1faa3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769651712:0@lo:256: 00000100:00100000:1.0:1789438101.817631:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438101.817658:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 00000000803f151f going to sleep for 11 seconds 00000100:00100000:2.0:1789438101.817811:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769651712 00000100:00100000:2.0:1789438101.817816:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769651712 00000100:00100000:2.0:1789438101.817845:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789438101.817851:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000001a9344a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:5836:x1876361769651712:12345-0@lo:256: 20000000:01000000:2.0:1789438101.817864:0:5832:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789438101.817878:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789438101.817880:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1789438101.817961:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000001a9344a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:5836:x1876361769651712:12345-0@lo:256: Request processed in 111us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438101.817968:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789438101.818048:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002fa1faa3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769651712:0@lo:256: 10000000:01000000:1.0:1789438101.818085:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789438101.818090:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: 0000000011559c5f/0x7a8dd0fcbb924a9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924aa3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438101.818098:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: 0000000011559c5f/0x7a8dd0fcbb924a9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924aa3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438102.395505:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438103.414927:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438104.449046:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438105.466514:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789438106.299320:0:6316:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd655a9590 20000000:00000080:3.0:1789438106.299343:0:6316:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff999201de8400 uarg=0000000000000000 20000000:01000000:3.0:1789438106.299378:0:6316:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789438106.299385:0:6316:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789438106.299389:0:6316:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789438106.303050:0:6316:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1789438106.303066:0:6316:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1789438106.311318:0:6316:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789438106.312382:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789438106.312472:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1789438106.312524:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1789438106.312542:0:6316:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789438106.312560:0:6316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e6357179/0x7a8dd0fcbb924aaa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438106.312577:0:6316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000eb3a785b/0x7a8dd0fcbb924a6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924a64 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438106.312584:0:6316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e6357179/0x7a8dd0fcbb924aaa lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438106.312619:0:6316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000eb3a785b/0x7a8dd0fcbb924a6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb924a64 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438106.312632:0:6316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000eb3a785b/0x7a8dd0fcbb924a6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924a64 expref: 11 pid: 5832 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438106.312645:0:6316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000763e2b89 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6316:1876361769651840:0@lo:104: 00000100:00100000:3.0:1789438106.312747:0:6316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438106.312796:0:6316:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e17811f7 going to sleep for 11 seconds 00000100:00100000:0.0:1789438106.313079:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769651840 00000100:00100000:0.0:1789438106.313087:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769651840 00000100:00100000:0.0:1789438106.313138:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789438106.313147:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009594265c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+3:6316:x1876361769651840:12345-0@lo:104: 00010000:00010000:0.0:1789438106.313159:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: 00000000a44f6957/0x7a8dd0fcbb924a64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924a6b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438106.313222:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789438106.313226:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009594265c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+3:6316:x1876361769651840:12345-0@lo:104: Request processed in 81us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438106.313232:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789438106.313308:0:6316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000763e2b89 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6316:1876361769651840:0@lo:104: 00010000:00010000:3.0:1789438106.313326:0:6316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e6357179/0x7a8dd0fcbb924aaa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438106.313393:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789438106.313398:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: 00000000a44f6957/0x7a8dd0fcbb924a64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924a6b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438106.313405:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a44f6957 already unused, calling callback (000000008b6d47a5) 10000000:00010000:2.0:1789438106.314584:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: 00000000a44f6957/0x7a8dd0fcbb924a64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb924a6b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438106.314596:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: 00000000a44f6957/0x7a8dd0fcbb924a64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb924a6b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789438106.314603:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: 00000000a44f6957/0x7a8dd0fcbb924a64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb924a6b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789438106.314609:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789438106.314648:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: 00000000a44f6957/0x7a8dd0fcbb924a64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924a6b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438106.314655:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789438106.314685:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: 00000000a44f6957/0x7a8dd0fcbb924a64 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924a6b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438106.314692:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: 00000000a44f6957/0x7a8dd0fcbb924a64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924a6b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438106.314727:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438106.314729:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438106.314731:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438106.314740:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789438106.314756:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b4d15f8f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769651968:0@lo:103: 00000100:00100000:2.0:1789438106.314950:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438106.315053:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769651968 00000100:00100000:3.0:1789438106.315059:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769651968 00010000:00010000:3.0:1789438106.315085:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000eb3a785b/0x7a8dd0fcbb924a6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924a64 expref: 12 pid: 5832 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438106.315118:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789438106.315125:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000013a99575 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+12:3311:x1876361769651968:12345-0@lo:103: 00010000:00010000:3.0:1789438106.315136:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438106.315140:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000eb3a785b/0x7a8dd0fcbb924a6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924a64 expref: 12 pid: 5832 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438106.315149:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000eb3a785b/0x7a8dd0fcbb924a6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924a64 expref: 12 pid: 5832 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438106.315161:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000eb3a785b/0x7a8dd0fcbb924a6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb924a64 expref: 12 pid: 5832 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438106.315174:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e6357179/0x7a8dd0fcbb924aaa lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438106.315181:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e6357179/0x7a8dd0fcbb924aaa lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438106.315194:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e6357179/0x7a8dd0fcbb924aaa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438106.315200:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e6357179/0x7a8dd0fcbb924aaa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438106.315206:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e6357179/0x7a8dd0fcbb924aaa lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438106.315218:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e6357179/0x7a8dd0fcbb924aaa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438106.315223:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e6357179 already unused, calling callback (000000000b527ec0) 00010000:00010000:3.0:1789438106.315226:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e6357179/0x7a8dd0fcbb924aaa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438106.315232:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e6357179/0x7a8dd0fcbb924aaa lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438106.315245:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e6357179/0x7a8dd0fcbb924aaa lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438106.315254:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789438106.315284:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000013a99575 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+11:3311:x1876361769651968:12345-0@lo:103: Request processed in 161us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438106.315291:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789438106.315318:0:6316:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e6357179/0x7a8dd0fcbb924aaa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438106.315326:0:6316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e6357179/0x7a8dd0fcbb924aaa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438106.315331:0:6316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e6357179/0x7a8dd0fcbb924aaa lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438106.315528:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b4d15f8f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769651968:0@lo:103: 00000100:00100000:3.0:1789438106.425592:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f1b161eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769652096:0@lo:400: 00000100:00100000:3.0:1789438106.425667:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438106.425785:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769652096 00000100:00100000:2.0:1789438106.425793:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769652096 00000100:00100000:2.0:1789438106.425843:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789438106.425851:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000763e2b89 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769652096:12345-0@lo:400: 00000100:00100000:2.0:1789438106.425928:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000763e2b89 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769652096:12345-0@lo:400: Request processed in 78us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438106.425935:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789438106.426119:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f1b161eb x1876361769652096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438106.426145:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f1b161eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769652096:0@lo:400: 00010000:00010000:0.0:1789438106.498578:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789438106.998954:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789438106.998962:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9991d197a000 from 1 10000000:01000000:0.0:1789438106.998967:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789438106.999071:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: 000000006ac23901/0x7a8dd0fcbb924ab1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438106.999095:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: 000000006ac23901/0x7a8dd0fcbb924ab1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438106.999106:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: 000000006ac23901/0x7a8dd0fcbb924ab1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438106.999127:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063bfdab1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769652224:0@lo:101: 00000100:00100000:0.0:1789438106.999191:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438106.999290:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e7b28a4 going to sleep for 11 seconds 00000100:00100000:3.0:1789438107.000939:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769652224 00000100:00100000:3.0:1789438107.000953:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769652224 00000100:00100000:3.0:1789438107.002552:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789438107.002563:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bffbbee2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+11:5836:x1876361769652224:12345-0@lo:101: 00010000:00010000:3.0:1789438107.002590:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438107.002607:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e6357179/0x7a8dd0fcbb924ab8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924ab1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438107.002636:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e6357179/0x7a8dd0fcbb924ab8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924ab1 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438107.002647:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e6357179/0x7a8dd0fcbb924ab8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924ab1 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438107.002655:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e6357179, rc 0) 00000100:00100000:3.0:1789438107.002756:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bffbbee2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+12:5836:x1876361769652224:12345-0@lo:101: Request processed in 196us (3565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438107.002763:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789438107.002873:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063bfdab1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769652224:0@lo:101: 00010000:00010000:0.0:1789438107.003092:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: 000000006ac23901/0x7a8dd0fcbb924ab1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924ab8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438107.003102:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: 000000006ac23901/0x7a8dd0fcbb924ab1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924ab8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438107.003165:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063bfdab1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769652352:0@lo:501: 00000100:00100000:0.0:1789438107.003200:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438107.012857:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769652352 00000100:00100000:2.0:1789438107.012873:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769652352 00000100:00100000:2.0:1789438107.012952:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789438107.012960:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000028d032a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:5836:x1876361769652352:12345-0@lo:501: 00000100:00100000:2.0:1789438107.013700:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000028d032a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:5836:x1876361769652352:12345-0@lo:501: Request processed in 738us (10497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438107.013728:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789438107.017218:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e7b28a4 going to sleep for 11 seconds 00000100:00100000:1.0:1789438107.017255:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063bfdab1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769652352:0@lo:501: 00000100:00100000:1.0:1789438107.017343:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002fa1faa3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769652480:0@lo:503: 00000100:00100000:1.0:1789438107.017414:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438107.017436:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bd1e8585 going to sleep for 11 seconds 00000100:00100000:2.0:1789438107.018772:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769652480 00000100:00100000:2.0:1789438107.018785:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769652480 00000100:00100000:2.0:1789438107.018857:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789438107.018866:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000aeb7b597 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:5836:x1876361769652480:12345-0@lo:503: 00000100:00100000:2.0:1789438107.019273:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000aeb7b597 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:5836:x1876361769652480:12345-0@lo:503: Request processed in 408us (1859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438107.019283:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789438107.021484:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002fa1faa3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769652480:0@lo:503: 00000100:00100000:1.0:1789438107.030533:0:6336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005addadfb pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:6336:1876361769652608:0@lo:502: 00000100:00100000:1.0:1789438107.031015:0:6336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438107.031089:0:6336:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bd1e8585 going to sleep for 11 seconds 00000100:00100000:3.0:1789438107.031237:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769652608 00000100:00100000:3.0:1789438107.031246:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769652608 00000100:00100000:3.0:1789438107.031299:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789438107.031309:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002c3cc7ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+12:6336:x1876361769652608:12345-0@lo:502: 00000100:00100000:3.0:1789438107.031549:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002c3cc7ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+12:6336:x1876361769652608:12345-0@lo:502: Request processed in 241us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438107.031568:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789438107.032063:0:6336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005addadfb pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:6336:1876361769652608:0@lo:502: 00000020:01000000:1.0:1789438107.032103:0:6336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789438107.032113:0:6336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438107.032115:0:6336:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789438107.032121:0:6336:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9991d197a000 00000020:00000080:1.0:1789438107.032123:0:6336:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789438107.032173:0:6336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3755880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:6336:1876361769652736:0@lo:502: 00000100:00100000:1.0:1789438107.032221:0:6336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438107.032257:0:6336:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fbaf1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789438107.032379:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769652736 00000100:00100000:3.0:1789438107.032385:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769652736 00000100:00100000:3.0:1789438107.032424:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789438107.032432:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+12:6336:x1876361769652736:12345-0@lo:502: 00000100:00100000:3.0:1789438107.032612:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+12:6336:x1876361769652736:12345-0@lo:502: Request processed in 180us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438107.032620:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789438107.032738:0:6336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3755880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:6336:1876361769652736:0@lo:502: 00000020:01000000:2.0:1789438107.032762:0:6336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789438107.032767:0:6336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789438107.032769:0:6336:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789438107.032772:0:6336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789438107.032966:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789438107.032985:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789438107.032994:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c0031600/0x7a8dd0fcbb924ab1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924ab8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438107.033014:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991c0031600/0x7a8dd0fcbb924ab1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924ab8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438107.510885:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438108.535419:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438109.570379:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438110.584593:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438111.543071:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789438111.544083:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3757800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876361769652992:0@lo:400: 00000100:00100000:2.0:1789438111.544177:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438111.546962:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769652992 00000100:00100000:1.0:1789438111.547073:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769652992 00000100:00100000:1.0:1789438111.547220:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789438111.547234:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876361769652992:12345-0@lo:400: 00000100:00100000:1.0:1789438111.547368:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876361769652992:12345-0@lo:400: Request processed in 138us (3191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438111.547376:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789438111.547485:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9991f3757800 x1876361769652992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438111.547504:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3757800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876361769652992:0@lo:400: 00000100:00100000:2.0:1789438111.551446:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769652864:0@lo:400: 00000100:00100000:2.0:1789438111.551561:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438111.551971:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769652864 00000100:00100000:1.0:1789438111.552097:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769652864 00000100:00100000:1.0:1789438111.552167:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789438111.552178:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:3309:x1876361769652864:12345-0@lo:400: 00000100:00100000:1.0:1789438111.552255:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:3309:x1876361769652864:12345-0@lo:400: Request processed in 78us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438111.552262:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789438111.552366:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769652864:0@lo:400: 00010000:00010000:0.0:1789438111.611260:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789438112.574862:0:6677:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789438112.574867:0:6677:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789438112.574971:0:6677:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9991d08f6800 00000020:01000004:2.0:1789438112.574985:0:6677:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789438112.574996:0:6677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789438112.575008:0:6677:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9991fae1b380) 00000020:00000080:2.0:1789438112.575022:0:6677:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789438112.593600:0:6677:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1789438112.594035:0:6677:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789438112.623384:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00010000:00010000:0.0:1789438112.630934:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1789438112.632355:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789438112.632388:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789438112.632440:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789438112.632463:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789438112.632948:0:6677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789438112.632958:0:6677:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789438112.632968:0:6677:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7a8dd0fcbb924ac6 00000020:01000004:2.0:1789438112.632977:0:6677:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789438112.632998:0:6677:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.109@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789438112.633002:0:6677:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789438112.633007:0:6677:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789438112.633011:0:6677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789438112.633023:0:6677:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9991fae199c0) 00000020:00000080:2.0:1789438112.633032:0:6677:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1789438112.637651:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789438112.637891:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789438112.637898:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789438112.646982:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789438112.646999:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789438112.647988:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789438112.648004:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789438112.649575:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789438112.649801:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789438112.649808:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789438112.651301:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789438112.651311:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789438112.673607:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789438112.674429:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789438112.674437:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789438112.677132:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789438112.677144:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789438112.679293:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789438112.679308:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789438112.685270:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789438112.685461:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789438112.685467:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789438112.687490:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789438112.687503:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789438112.728413:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789438112.728688:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789438112.728695:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789438112.731266:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789438112.731282:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789438112.732240:0:6677:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789438112.732264:0:6677:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1789438112.732270:0:6677:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.109@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789438112.775297:0:6677:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.109@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789438112.775338:0:6677:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.109@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789438112.775342:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789438112.775344:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789438112.775345:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789438112.775346:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789438112.775347:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789438112.775348:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789438112.775349:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789438112.775351:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789438112.775352:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789438112.775353:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789438112.775355:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789438112.775358:0:6677:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789438112.775361:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789438112.775362:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789438112.775364:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789438112.775365:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789438112.775366:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789438112.775367:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789438112.775368:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789438112.775369:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789438112.775370:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789438112.775371:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789438112.775372:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789438112.775398:0:6677:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789438112.775419:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f419b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769653120:0@lo:253: 00000100:00100000:2.0:1789438112.775491:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438112.775553:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fa9a9840 going to sleep for 11 seconds 00000100:00100000:1.0:1789438112.776168:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769653120 00000100:00100000:1.0:1789438112.776177:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769653120 00000100:00100000:1.0:1789438112.776238:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789438112.776249:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+12:6677:x1876361769653120:12345-0@lo:253: 20000000:01000000:3.0:1789438112.776416:0:5833:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789438112.776421:0:5833:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789438112.776425:0:5833:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789438112.776429:0:5833:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1789438112.778415:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789438112.779326:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1789438112.779345:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1789438112.779404:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1789438112.779411:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1789438112.779452:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1789438112.779522:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1789438112.782208:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1789438112.782242:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.109@tcp 20000000:01000000:3.0:1789438112.782245:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.109@tcp (null) (null) (null) 00000040:00080000:3.0:1789438112.782308:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1789438112.782316:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789438112.782375:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1789438112.782385:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.109@tcp (null) (null) 00000040:00080000:3.0:1789438112.782420:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1789438112.782431:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789438112.782464:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1789438112.782535:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1789438112.783322:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1789438112.783340:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.109@tcp 20000000:01000000:3.0:1789438112.783342:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.109@tcp (null) (null) (null) 00000040:00080000:3.0:1789438112.783378:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1789438112.783386:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789438112.783419:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1789438112.783427:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.109@tcp (null) (null) 00000040:00080000:3.0:1789438112.783816:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1789438112.783828:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789438112.783879:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1789438112.783916:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1789438112.783933:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1789438112.783936:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1789438112.783941:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789438112.783942:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789438112.783944:0:5833:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789438112.783961:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789438112.783964:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789438112.783993:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789438112.783995:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789438112.785169:0:6692:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1789438112.785243:0:6692:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1789438112.785293:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1789438112.785977:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1789438112.786021:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1789438112.786056:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1789438112.786072:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789438112.786075:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789438112.786647:0:6693:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1789438112.786903:0:6693:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1789438112.786965:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1789438112.787233:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1789438112.787272:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1789438112.787326:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1789438112.787340:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789438112.787342:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789438112.788485:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1789438112.788925:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1789438112.788962:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1789438112.789018:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:0.0:1789438112.789036:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789438112.789058:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924ad4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438112.789076:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991c2a55400/0x7a8dd0fcbb9249ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb9249e6 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438112.789084:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991e0966e00/0x7a8dd0fcbb924a09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924a02 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438112.789091:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991e0966800/0x7a8dd0fcbb924a79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924a72 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438112.789106:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924ad4 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438112.789140:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991e0966800/0x7a8dd0fcbb924a79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb924a72 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438112.789156:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9991e0966800/0x7a8dd0fcbb924a79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924a72 expref: 12 pid: 5832 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438112.789169:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1876361769653248:0@lo:104: 00000100:00100000:0.0:1789438112.789241:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789438112.789594:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991e0966e00/0x7a8dd0fcbb924a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb924a02 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438112.789604:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9991e0966e00/0x7a8dd0fcbb924a09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924a02 expref: 12 pid: 5831 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438112.789613:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1876361769653376:0@lo:104: 00000100:00100000:0.0:1789438112.789637:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789438112.789657:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991c2a55400/0x7a8dd0fcbb9249ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb9249e6 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438112.789666:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9991c2a55400/0x7a8dd0fcbb9249ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb9249e6 expref: 12 pid: 5832 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438112.789680:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1876361769653504:0@lo:104: 00000100:00100000:0.0:1789438112.789739:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438112.789750:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c7d92240 going to sleep for 11 seconds 00000100:00100000:1.0:1789438112.790367:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769653248 00000100:00100000:1.0:1789438112.790375:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769653248 00000100:00100000:1.0:1789438112.790411:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769653376 00000100:00100000:1.0:1789438112.790414:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769653376 00000100:00100000:1.0:1789438112.790422:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769653504 00000100:00100000:1.0:1789438112.790424:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769653504 00000100:00100000:1.0:1789438112.790435:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789438112.790444:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+5:5833:x1876361769653248:12345-0@lo:104: 00010000:00010000:1.0:1789438112.790459:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff999202045a00/0x7a8dd0fcbb924a72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924a79 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438112.790797:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1876361769653248:0@lo:104: 00010000:00010000:1.0:1789438112.790940:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789438112.790946:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+5:5833:x1876361769653248:12345-0@lo:104: Request processed in 504us (1706us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438112.790954:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789438112.790975:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789438112.790982:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+4:5833:x1876361769653376:12345-0@lo:104: 00010000:00010000:1.0:1789438112.790998:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff999202045600/0x7a8dd0fcbb924a02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924a09 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438112.791076:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1876361769653376:0@lo:104: 00000100:00100000:2.0:1789438112.791134:0:5820:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1789438112.791143:0:5820:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:2.0:1789438112.791580:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789438112.791588:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7073a0da-08cf-42fe-8791-a8c6139408f2+4:5833:x1876361769653504:12345-0@lo:104: 00010000:00010000:2.0:1789438112.791604:0:6695:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb9249e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb9249ed expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438112.791723:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1876361769653504:0@lo:104: 00010000:00010000:0.0:1789438112.791750:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924ad4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.792048:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789438112.792056:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff999202045a00/0x7a8dd0fcbb924a72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924a79 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.792064:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999202045a00 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:3.0:1789438112.792068:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff999202045a00/0x7a8dd0fcbb924a72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb924a79 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.792076:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff999202045a00/0x7a8dd0fcbb924a72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb924a79 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789438112.792083:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff999202045a00/0x7a8dd0fcbb924a72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb924a79 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789438112.792089:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789438112.792122:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff999202045a00/0x7a8dd0fcbb924a72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924a79 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.792130:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789438112.792144:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff999202045a00/0x7a8dd0fcbb924a72 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924a79 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.792162:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff999202045a00/0x7a8dd0fcbb924a72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924a79 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.792176:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789438112.792179:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff999202045600/0x7a8dd0fcbb924a02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924a09 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.792184:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999202045600 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:3.0:1789438112.792187:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff999202045600/0x7a8dd0fcbb924a02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb924a09 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.792194:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff999202045600/0x7a8dd0fcbb924a02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb924a09 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789438112.792201:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff999202045600/0x7a8dd0fcbb924a02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb924a09 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789438112.792205:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789438112.792221:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff999202045600/0x7a8dd0fcbb924a02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924a09 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.792226:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789438112.792241:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff999202045600/0x7a8dd0fcbb924a02 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924a09 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.792247:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff999202045600/0x7a8dd0fcbb924a02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924a09 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.792256:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789438112.792264:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb9249e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb9249ed expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.792269:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999202045200 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:3.0:1789438112.792272:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb9249e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb9249ed expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.792278:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb9249e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb9249ed expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789438112.792295:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb9249e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb9249ed expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789438112.792301:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789438112.792315:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb9249e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb9249ed expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.792320:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789438112.792326:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb9249e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb9249ed expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.792332:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb9249e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb9249ed expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.792346:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438112.792348:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438112.792350:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438112.792366:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769653760:0@lo:103: 00000100:00100000:3.0:1789438112.792404:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438112.792441:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789438112.792447:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769653888:0@lo:103: 00000100:00100000:3.0:1789438112.792476:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438112.792658:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769653760 00000100:00100000:3.0:1789438112.792665:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769653760 00010000:00010000:3.0:1789438112.792833:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991e0966e00/0x7a8dd0fcbb924a09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924a02 expref: 13 pid: 5831 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438112.792866:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769653888 00000100:00100000:3.0:1789438112.792870:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769653888 00010000:00010000:3.0:1789438112.792882:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991c2a55400/0x7a8dd0fcbb9249ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb9249e6 expref: 14 pid: 5832 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438112.792894:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789438112.792900:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+14:3309:x1876361769653760:12345-0@lo:103: 00010000:00010000:3.0:1789438112.792910:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438112.792915:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991e0966e00/0x7a8dd0fcbb924a09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924a02 expref: 14 pid: 5831 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.792924:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991e0966e00/0x7a8dd0fcbb924a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924a02 expref: 14 pid: 5831 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.792938:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991e0966e00/0x7a8dd0fcbb924a09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb924a02 expref: 14 pid: 5831 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.792952:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789438112.792983:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+13:3309:x1876361769653760:12345-0@lo:103: Request processed in 82us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438112.792989:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789438112.793006:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789438112.793011:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+12:3309:x1876361769653888:12345-0@lo:103: 00010000:00010000:3.0:1789438112.793018:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438112.793028:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991c2a55400/0x7a8dd0fcbb9249ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb9249e6 expref: 12 pid: 5832 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.793035:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991c2a55400/0x7a8dd0fcbb9249ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb9249e6 expref: 12 pid: 5832 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.793044:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c2a55400/0x7a8dd0fcbb9249ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb9249e6 expref: 12 pid: 5832 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.793052:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789438112.793073:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+11:3309:x1876361769653888:12345-0@lo:103: Request processed in 62us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438112.793079:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789438112.793111:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769653888:0@lo:103: 00000100:00100000:3.0:1789438112.793119:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769653760:0@lo:103: 00000100:00100000:0.0:1789438112.793197:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769653632:0@lo:103: 00000100:00100000:0.0:1789438112.793225:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438112.793314:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769653632 00000100:00100000:3.0:1789438112.793320:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769653632 00010000:00010000:3.0:1789438112.793335:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991e0966800/0x7a8dd0fcbb924a79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924a72 expref: 11 pid: 5832 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438112.793399:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789438112.793406:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+11:3312:x1876361769653632:12345-0@lo:103: 00010000:00010000:3.0:1789438112.793412:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438112.793416:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991e0966800/0x7a8dd0fcbb924a79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924a72 expref: 11 pid: 5832 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.793425:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991e0966800/0x7a8dd0fcbb924a79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924a72 expref: 11 pid: 5832 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.793437:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991e0966800/0x7a8dd0fcbb924a79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb924a72 expref: 11 pid: 5832 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.793456:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924ad4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.793463:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924ad4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.793476:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924ad4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.793483:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924ad4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.793489:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924ad4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.793497:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924ad4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.793513:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c0031400 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:3.0:1789438112.793519:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924ad4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.793525:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924ad4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.793538:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924ad4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.793547:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789438112.793858:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+10:3312:x1876361769653632:12345-0@lo:103: Request processed in 441us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438112.793873:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789438112.793926:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1789438112.793934:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+4:5833:x1876361769653376:12345-0@lo:104: Request processed in 2952us (4295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438112.793940:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789438112.794088:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1789438112.794096:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7073a0da-08cf-42fe-8791-a8c6139408f2+3:5833:x1876361769653504:12345-0@lo:104: Request processed in 2508us (4356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438112.794102:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789438112.794158:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438112.794221:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438112.794239:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769653632:0@lo:103: 00010000:00010000:0.0:1789438112.794259:0:5833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924ad4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438112.794266:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924ad4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438112.794272:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924ad4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789438112.794298:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789438112.880914:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+9:6677:x1876361769653120:12345-0@lo:253: Request processed in 104659us (105414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438112.880929:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789438112.881036:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f419b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769653120:0@lo:253: 10000000:01000000:2.0:1789438112.881050:0:6677:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789438112.881053:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789438112.881055:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789438112.881056:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789438112.881057:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789438112.881058:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789438112.881060:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789438112.881061:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789438112.881062:0:6677:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789438112.881064:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789438112.881065:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789438112.881083:0:6677:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9991d08f6800 from lustre-OST0000 10000000:01000000:2.0:1789438112.881130:0:6677:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789438112.881133:0:6677:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789438112.881140:0:6677:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9991e1e54d40 local copy 10000000:01000000:2.0:1789438112.881144:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789438112.881182:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924adb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438112.881193:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924adb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438112.881202:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924adb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438112.881234:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f419b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769654016:0@lo:101: 00000100:00100000:2.0:1789438112.881270:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438112.881320:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c6cbe540 going to sleep for 11 seconds 00000100:00100000:0.0:1789438112.881484:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769654016 00000100:00100000:0.0:1789438112.881490:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769654016 00000100:00100000:0.0:1789438112.881569:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789438112.881580:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+9:6677:x1876361769654016:12345-0@lo:101: 00010000:00010000:0.0:1789438112.881592:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438112.881607:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924ae2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924adb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438112.881630:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924ae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924adb expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438112.881648:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924ae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924adb expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438112.881656:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c0031400, rc 0) 00000100:00100000:0.0:1789438112.881727:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+10:6677:x1876361769654016:12345-0@lo:101: Request processed in 131us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438112.881733:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789438112.881805:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f419b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769654016:0@lo:101: 00010000:00010000:1.0:1789438112.881817:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924adb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x7a8dd0fcbb924ae2 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438112.881826:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924adb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7a8dd0fcbb924ae2 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438112.881935:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3757100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769654144:0@lo:501: 00000100:00100000:1.0:1789438112.881961:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438112.882237:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e07629c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789438112.882305:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769654144 00000100:00100000:2.0:1789438112.882310:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769654144 00000100:00100000:2.0:1789438112.882333:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789438112.882340:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+10:6677:x1876361769654144:12345-0@lo:501: 00000100:00100000:2.0:1789438112.882542:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+10:6677:x1876361769654144:12345-0@lo:501: Request processed in 202us (579us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789438112.882550:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789438112.882626:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3757100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769654144:0@lo:501: 10000000:01000000:1.0:1789438112.882640:0:6677:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789438112.882665:0:6677:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789438112.882670:0:6677:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924adb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7a8dd0fcbb924ae2 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438112.882701:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924adb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7a8dd0fcbb924ae2 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438112.882723:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924adb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7a8dd0fcbb924ae2 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438112.882745:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789438112.882765:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9991d08f6800 10000000:01000000:1.0:1789438112.882769:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789438112.882782:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9991e1e54d40 10000000:01000000:1.0:1789438112.882785:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789438112.882789:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9991e1e54d40 from 1 10000000:01000000:1.0:1789438112.882791:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789438112.882811:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991e0967a00/0x7a8dd0fcbb924ae9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438112.882819:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991e0967a00/0x7a8dd0fcbb924ae9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438112.882828:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991e0967a00/0x7a8dd0fcbb924ae9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438112.882840:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3757100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769654272:0@lo:101: 00000100:00100000:1.0:1789438112.882877:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438112.882893:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e0762000 going to sleep for 11 seconds 00000100:00100000:1.0:1789438112.882906:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769654272 00000100:00100000:1.0:1789438112.882910:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769654272 00000100:00100000:1.0:1789438112.882928:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789438112.882934:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+10:6677:x1876361769654272:12345-0@lo:101: 00010000:00010000:1.0:1789438112.882948:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438112.882958:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991e0966a00/0x7a8dd0fcbb924af0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924ae9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438112.882974:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991e0966a00/0x7a8dd0fcbb924af0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924ae9 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438112.882984:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991e0966a00/0x7a8dd0fcbb924af0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924ae9 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438112.882990:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e0966a00, rc 0) 00000100:00100000:1.0:1789438112.883018:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+11:6677:x1876361769654272:12345-0@lo:101: Request processed in 85us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438112.883024:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789438112.883056:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3757100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769654272:0@lo:101: 00010000:00010000:1.0:1789438112.883066:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991e0967a00/0x7a8dd0fcbb924ae9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924af0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438112.883074:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991e0967a00/0x7a8dd0fcbb924ae9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924af0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789438112.883087:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789438112.883097:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991e0967a00/0x7a8dd0fcbb924ae9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924af0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438112.883104:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991e0967a00/0x7a8dd0fcbb924ae9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924af0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789438112.883110:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789438112.883119:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789438112.883123:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789438112.883125:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789438112.883137:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991e0966c00/0x7a8dd0fcbb924af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438112.883145:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991e0966c00/0x7a8dd0fcbb924af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438112.883152:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991e0966c00/0x7a8dd0fcbb924af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438112.883163:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3757100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769654400:0@lo:101: 00000100:00100000:1.0:1789438112.883185:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438112.883197:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e0762000 going to sleep for 11 seconds 00000100:00100000:1.0:1789438112.883209:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769654400 00000100:00100000:1.0:1789438112.883213:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769654400 00000100:00100000:1.0:1789438112.883228:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789438112.883234:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+11:6677:x1876361769654400:12345-0@lo:101: 00010000:00010000:1.0:1789438112.883240:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438112.883247:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991e0967000/0x7a8dd0fcbb924afe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924af7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438112.883259:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991e0967000/0x7a8dd0fcbb924afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924af7 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438112.883267:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991e0967000/0x7a8dd0fcbb924afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924af7 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438112.883274:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e0967000, rc 0) 00000100:00100000:1.0:1789438112.883305:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:6677:x1876361769654400:12345-0@lo:101: Request processed in 71us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438112.883312:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789438112.883339:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3757100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769654400:0@lo:101: 00010000:00010000:1.0:1789438112.883348:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991e0966c00/0x7a8dd0fcbb924af7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924afe expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438112.883356:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991e0966c00/0x7a8dd0fcbb924af7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924afe expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438112.883407:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3757100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769654528:0@lo:501: 00000100:00100000:1.0:1789438112.883428:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438112.883440:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e0762000 going to sleep for 11 seconds 00000100:00100000:1.0:1789438112.883451:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769654528 00000100:00100000:1.0:1789438112.883455:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769654528 00000100:00100000:1.0:1789438112.883469:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789438112.883474:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:6677:x1876361769654528:12345-0@lo:501: 00000100:00100000:1.0:1789438112.883627:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:6677:x1876361769654528:12345-0@lo:501: Request processed in 152us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438112.883633:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789438112.883661:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3757100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769654528:0@lo:501: 00000100:00100000:1.0:1789438112.883684:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3757100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769654656:0@lo:503: 00000100:00100000:1.0:1789438112.883741:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438112.883754:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e0762000 going to sleep for 11 seconds 00000100:00100000:1.0:1789438112.883767:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769654656 00000100:00100000:1.0:1789438112.883771:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769654656 00000100:00100000:1.0:1789438112.883786:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789438112.883798:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:6677:x1876361769654656:12345-0@lo:503: 00000100:00100000:1.0:1789438112.883943:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:6677:x1876361769654656:12345-0@lo:503: Request processed in 145us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438112.883950:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789438112.883989:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3757100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769654656:0@lo:503: 00000040:00080000:1.0:1789438112.884213:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789438112.884271:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3757100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769654784:0@lo:502: 00000100:00100000:1.0:1789438112.884300:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438112.884312:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e0762000 going to sleep for 11 seconds 00000100:00100000:1.0:1789438112.884325:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769654784 00000100:00100000:1.0:1789438112.884328:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769654784 00000100:00100000:1.0:1789438112.884343:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789438112.884348:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:6677:x1876361769654784:12345-0@lo:502: 00000100:00100000:1.0:1789438112.884463:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:6677:x1876361769654784:12345-0@lo:502: Request processed in 114us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438112.884470:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789438112.884507:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3757100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769654784:0@lo:502: 00000040:00080000:1.0:1789438112.884773:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789438112.884816:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789438112.884867:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789438112.884929:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789438112.884970:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789438112.885004:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789438112.885026:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3757100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769654912:0@lo:502: 00000100:00100000:1.0:1789438112.885061:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438112.885077:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f3f74000 going to sleep for 11 seconds 00000100:00100000:1.0:1789438112.885092:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769654912 00000100:00100000:1.0:1789438112.885101:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769654912 00000100:00100000:1.0:1789438112.885120:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789438112.885125:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:6677:x1876361769654912:12345-0@lo:502: 00000100:00100000:1.0:1789438112.885247:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:6677:x1876361769654912:12345-0@lo:502: Request processed in 121us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438112.885253:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789438112.885292:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3757100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769654912:0@lo:502: 00000040:00080000:1.0:1789438112.885363:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789438112.885372:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00010000:00010000:2.0:1789438112.885703:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789438112.885730:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924adb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7a8dd0fcbb924ae2 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438112.885740:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999202045800 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:2.0:1789438112.885744:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924adb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7a8dd0fcbb924ae2 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438112.885754:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x7a8dd0fcbb924ae2 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789438112.885761:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x7a8dd0fcbb924ae2 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789438112.885767:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789438112.885800:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924adb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7a8dd0fcbb924ae2 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438112.885818:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789438112.885843:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924adb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7a8dd0fcbb924ae2 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438112.885861:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924adb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7a8dd0fcbb924ae2 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438112.885874:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438112.885876:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438112.885878:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438112.886116:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f4199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769655040:0@lo:103: 00000100:00100000:0.0:1789438112.886153:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438112.886204:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769655040 00000100:00100000:0.0:1789438112.886208:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769655040 00000100:00100000:0.0:1789438112.886241:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789438112.886248:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7073a0da-08cf-42fe-8791-a8c6139408f2+12:3311:x1876361769655040:12345-0@lo:103: 00010000:00010000:0.0:1789438112.886258:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438112.886270:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924ae2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7a8dd0fcbb924adb expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438112.886282:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438112.886313:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7073a0da-08cf-42fe-8791-a8c6139408f2+11:3311:x1876361769655040:12345-0@lo:103: Request processed in 66us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438112.886319:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789438112.886346:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f4199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769655040:0@lo:103: 00000020:01000000:2.0:1789438112.887192:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789438112.887200:0:6697:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1789438112.887207:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789438112.887209:0:6697:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789438112.887214:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789438112.887227:0:6697:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9991fae18000) 00000020:00000080:2.0:1789438112.887244:0:6697:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789438112.887249:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789438112.887324:0:6697:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9991d08f6800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789438112.887331:0:6697:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789438112.887337:0:6697:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7a8dd0fcbb924b0c 00010000:00010000:2.0:1789438112.894151:0:6697:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1789438112.894493:0:6697:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1789438112.899225:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789438112.899700:0:6697:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1789438112.907584:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1789438112.908207:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1789438112.911077:0:6697:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789438112.911090:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789438112.911099:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789438112.911101:0:6697:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789438112.911105:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789438112.911109:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789438112.911110:0:6697:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789438112.911113:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789438112.911114:0:6697:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789438112.911167:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789438112.911171:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789438112.911173:0:6697:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789438112.911176:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789438112.912210:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1789438112.912301:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789438112.912315:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991e0966c00/0x7a8dd0fcbb924af7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924afe expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438112.912328:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991e0966c00/0x7a8dd0fcbb924af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924afe expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789438112.912336:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9991d08f6800 from 1 10000000:01000000:1.0:1789438112.912338:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789438112.912372:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991e0966800/0x7a8dd0fcbb924b13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438112.912380:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991e0966800/0x7a8dd0fcbb924b13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438112.912391:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991e0966800/0x7a8dd0fcbb924b13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438112.912414:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3757100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769655168:0@lo:101: 00000100:00100000:1.0:1789438112.912482:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438112.912546:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f3f74000 going to sleep for 11 seconds 00000100:00100000:3.0:1789438112.912594:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769655168 00000100:00100000:3.0:1789438112.912601:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769655168 00000100:00100000:3.0:1789438112.912645:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789438112.912654:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+11:6677:x1876361769655168:12345-0@lo:101: 00010000:00010000:3.0:1789438112.912665:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438112.912677:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c2a55400/0x7a8dd0fcbb924b1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924b13 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.912864:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c2a55400/0x7a8dd0fcbb924b1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924b13 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.912876:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c2a55400/0x7a8dd0fcbb924b1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924b13 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.912893:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a55400, rc 0) 00000100:00100000:3.0:1789438112.913096:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:6677:x1876361769655168:12345-0@lo:101: Request processed in 443us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438112.913103:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789438112.913165:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3757100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769655168:0@lo:101: 00010000:00010000:1.0:1789438112.913179:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991e0966800/0x7a8dd0fcbb924b13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924b1a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438112.913188:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991e0966800/0x7a8dd0fcbb924b13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924b1a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438112.913355:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3757100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769655296:0@lo:501: 00000100:00100000:1.0:1789438112.913381:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438112.913442:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f3f74000 going to sleep for 11 seconds 00000100:00100000:3.0:1789438112.913474:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769655296 00000100:00100000:3.0:1789438112.913479:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769655296 00000100:00100000:3.0:1789438112.913512:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789438112.913519:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+12:6677:x1876361769655296:12345-0@lo:501: 00000100:00100000:3.0:1789438112.913896:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+12:6677:x1876361769655296:12345-0@lo:501: Request processed in 377us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438112.913904:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789438112.914150:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3757100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769655296:0@lo:501: 00000100:00100000:0.0:1789438112.914184:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769655424:0@lo:503: 00000100:00100000:0.0:1789438112.914300:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438112.914367:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e5053b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789438112.914409:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769655424 00000100:00100000:3.0:1789438112.914414:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769655424 00000100:00100000:3.0:1789438112.914488:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789438112.914496:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:6677:x1876361769655424:12345-0@lo:503: 00000100:00100000:0.0:1789438112.915129:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769655424:0@lo:503: 00000100:00100000:3.0:1789438112.915299:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:6677:x1876361769655424:12345-0@lo:503: Request processed in 802us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438112.915307:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000040:00080000:0.0:1789438112.915536:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789438112.915599:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769655552:0@lo:502: 00000100:00100000:0.0:1789438112.915643:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438112.915728:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e5053b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789438112.915903:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769655552 00000100:00100000:3.0:1789438112.915909:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769655552 00000100:00100000:3.0:1789438112.916100:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789438112.916109:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+12:6677:x1876361769655552:12345-0@lo:502: 00000100:00100000:3.0:1789438112.916303:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+12:6677:x1876361769655552:12345-0@lo:502: Request processed in 196us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438112.916310:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789438112.916696:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769655552:0@lo:502: 00000040:00080000:3.0:1789438112.920638:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789438112.925110:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789438112.925183:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769655680:0@lo:502: 00000100:00100000:3.0:1789438112.925265:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438112.925314:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fa8ac180 going to sleep for 11 seconds 00000100:00100000:1.0:1789438112.925697:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769655680 00000100:00100000:1.0:1789438112.925729:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769655680 00000100:00100000:1.0:1789438112.925786:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789438112.925795:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:6677:x1876361769655680:12345-0@lo:502: 00000100:00100000:1.0:1789438112.926035:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:6677:x1876361769655680:12345-0@lo:502: Request processed in 240us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438112.926045:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789438112.926321:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769655680:0@lo:502: 00000040:00080000:3.0:1789438112.926598:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789438112.926613:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789438112.928454:0:6701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789438112.928467:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789438112.928470:0:6701:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789438112.928476:0:6701:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9991d08f6800 00000020:00000080:3.0:1789438112.928478:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789438112.928498:0:6701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789438112.928632:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789438112.928635:0:6701:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789438112.928640:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789438112.928984:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789438112.929012:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789438112.929037:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991e0966800/0x7a8dd0fcbb924b13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924b1a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438112.929049:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991e0966800/0x7a8dd0fcbb924b13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924b1a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789438112.929092:0:6677:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789438112.929095:0:6677:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9991d08f6800 10000000:01000000:0.0:1789438112.929098:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9991d08f6800 10000000:01000000:0.0:1789438112.929102:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789438112.929109:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9991d08f6800 from 1 10000000:01000000:0.0:1789438112.929112:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789438112.929152:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924b21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438112.929161:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924b21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438112.929172:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924b21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438112.929193:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769655808:0@lo:101: 00000100:00100000:0.0:1789438112.929268:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438112.929312:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e5053600 going to sleep for 11 seconds 00000100:00100000:3.0:1789438112.929458:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769655808 00000100:00100000:3.0:1789438112.929465:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769655808 00000100:00100000:3.0:1789438112.929581:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789438112.929590:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+12:6677:x1876361769655808:12345-0@lo:101: 00010000:00010000:3.0:1789438112.929603:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438112.929615:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c2a54a00/0x7a8dd0fcbb924b28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924b21 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.929635:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c2a54a00/0x7a8dd0fcbb924b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924b21 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.929646:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c2a54a00/0x7a8dd0fcbb924b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924b21 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438112.929665:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a54a00, rc 0) 00000100:00100000:3.0:1789438112.930476:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+13:6677:x1876361769655808:12345-0@lo:101: Request processed in 118us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438112.930485:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789438112.932652:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769655808:0@lo:101: 00010000:00010000:0.0:1789438112.932679:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924b21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924b28 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438112.932691:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924b21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924b28 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438112.933073:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769655936:0@lo:501: 00000100:00100000:0.0:1789438112.935596:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438112.935689:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e5053600 going to sleep for 11 seconds 00000100:00100000:0.0:1789438112.936356:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769655936 00000100:00100000:0.0:1789438112.936436:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769655936 00000100:00100000:0.0:1789438112.937197:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789438112.937210:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+13:6677:x1876361769655936:12345-0@lo:501: 00000100:00100000:0.0:1789438112.937599:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+13:6677:x1876361769655936:12345-0@lo:501: Request processed in 392us (2008us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438112.937607:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789438112.938069:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769655936:0@lo:501: 00000100:00100000:3.0:1789438112.938117:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769656064:0@lo:503: 00000100:00100000:3.0:1789438112.938163:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438112.938237:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fa8ac600 going to sleep for 11 seconds 00000100:00100000:0.0:1789438112.938288:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769656064 00000100:00100000:0.0:1789438112.938294:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769656064 00000100:00100000:0.0:1789438112.938332:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789438112.938340:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+13:6677:x1876361769656064:12345-0@lo:503: 00000100:00100000:2.0:1789438112.938649:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769656064:0@lo:503: 00000040:00080000:2.0:1789438112.938963:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789438112.939023:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f4198e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769656192:0@lo:502: 00000100:00100000:0.0:1789438112.939091:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+13:6677:x1876361769656064:12345-0@lo:503: Request processed in 751us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438112.939099:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789438112.939569:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438112.939645:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991ffbbca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789438112.939680:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769656192 00000100:00100000:0.0:1789438112.939691:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769656192 00000100:00100000:0.0:1789438112.940005:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789438112.940015:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+13:6677:x1876361769656192:12345-0@lo:502: 00000100:00100000:0.0:1789438112.940210:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+13:6677:x1876361769656192:12345-0@lo:502: Request processed in 195us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438112.940216:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789438112.940320:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f4198e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769656192:0@lo:502: 00000040:00080000:2.0:1789438112.940584:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789438112.940633:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789438112.940668:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789438112.941370:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789438112.941437:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789438112.947493:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789438112.947627:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789438112.947664:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789438112.947986:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789438112.948030:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789438112.948064:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789438112.948117:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789438112.948155:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789438112.948191:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789438112.948238:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789438112.948274:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789438112.948310:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789438112.948355:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789438112.948588:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789438112.948626:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789438112.948704:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789438112.948981:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789438112.949016:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789438112.949062:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789438112.949098:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1789438112.949150:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1789438112.949194:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1789438112.949227:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1789438112.949271:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769656320:0@lo:502: 00000100:00100000:3.0:1789438112.949339:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438112.949453:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fa8ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1789438112.950275:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769656320 00000100:00100000:1.0:1789438112.950287:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769656320 00000100:00100000:1.0:1789438112.950335:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789438112.950344:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+13:6677:x1876361769656320:12345-0@lo:502: 00000100:00100000:1.0:1789438112.950610:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+13:6677:x1876361769656320:12345-0@lo:502: Request processed in 265us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438112.950618:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789438112.950662:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769656320:0@lo:502: 00000040:00080000:2.0:1789438112.950804:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789438112.950818:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1789438112.952154:0:6702:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789438112.952186:0:6702:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9991ffba0000) 00000020:00000080:1.0:1789438112.952206:0:6702:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1789438112.952292:0:6702:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9991d08f6800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789438112.952297:0:6702:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9991d08f6800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789438112.952299:0:6702:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9991d08f6800 3 00010000:00080000:1.0:1789438112.952325:0:6702:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9991de19f000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.109@tcp at head 00010000:00010000:1.0:1789438112.953825:0:6702:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1789438112.955490:0:6702:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789438112.955543:0:6702:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789438112.955556:0:6702:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x7a8dd0fcbb924b36 00000100:00080000:2.0:1789438112.955566:0:6702:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789438112.955576:0:6702:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9991de19f000 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:2.0:1789438112.955609:0:6702:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9991f4198e00 x1876361769656448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789438112.955643:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f4198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1876361769656448:0@lo:38: 00000100:00100000:2.0:1789438112.958125:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789438112.958271:0:6702:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789438112.959138:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769656448 00000100:00100000:0.0:1789438112.959148:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769656448 00000100:00100000:0.0:1789438112.959226:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789438112.959234:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f419b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1876361769656448:12345-0@lo:38: 00010000:00080000:0.0:1789438112.959261:0:5840:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 165 last 0 00000020:00000080:0.0:1789438112.959305:0:5840:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x7a8dd0fcbb924b3d 00000004:00100000:0.0:1789438112.959320:0:5840:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789438112.959350:0:5840:0:(import.c:65:import_set_state_nolock()) ffff9991c80fe800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789438112.959436:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f419b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876361769656448:12345-0@lo:38: Request processed in 202us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438112.959444:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789438112.959524:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9991f4198e00 x1876361769656448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789438122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438112.959534:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789438112.959542:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789438112.959549:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789438112.959555:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789438112.959557:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9991de19f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789438112.959563:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f4198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1876361769656448:0@lo:38: 00000100:00100000:3.0:1789438112.960352:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876361769656576:0@lo:400: 00000100:00100000:3.0:1789438112.960411:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438112.960631:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769656576 00000100:00100000:2.0:1789438112.960637:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769656576 00000100:00100000:2.0:1789438112.960671:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789438112.960678:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876361769656576:12345-0@lo:400: 00000100:00100000:2.0:1789438112.960748:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876361769656576:12345-0@lo:400: Request processed in 71us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438112.960755:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789438112.963104:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9991e06f9180 x1876361769656576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438112.963124:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876361769656576:0@lo:400: 00000040:00080000:2.0:1789438112.964444:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1789438112.964656:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1789438112.964698:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789438112.964752:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924b21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924b28 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438112.964764:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924b21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924b28 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789438112.965100:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789438112.965103:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789438112.965104:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789438112.965105:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789438112.965110:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789438112.965112:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789438112.965113:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789438112.965115:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789438112.965116:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789438112.965117:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789438112.965119:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789438112.965122:0:6677:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1789438112.965124:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789438112.965125:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789438112.965126:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789438112.965127:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789438112.965127:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789438112.965128:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789438112.965129:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789438112.965130:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789438112.965131:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789438112.965132:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789438112.965133:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789438112.965157:0:6677:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789438112.965173:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769656704:0@lo:253: 00000100:00100000:0.0:1789438112.965237:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438112.965315:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e50533c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789438112.968536:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769656704 00000100:00100000:2.0:1789438112.968548:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769656704 00000100:00100000:2.0:1789438112.968597:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789438112.968606:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+13:6677:x1876361769656704:12345-0@lo:253: 20000000:01000000:2.0:1789438112.968635:0:5832:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789438112.968646:0:5832:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789438113.009336:0:5832:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789438113.009397:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789438113.016593:0:5854:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789438113.016604:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789438113.016633:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff999202045800/0x7a8dd0fcbb924b44 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438113.016652:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb924aa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924a9c expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438113.016660:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff999202045800/0x7a8dd0fcbb924b44 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438113.016700:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb924aa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb924a9c expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438113.016732:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb924aa3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924a9c expref: 13 pid: 5833 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438113.016746:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f419b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1876361769656832:0@lo:104: 00000100:00100000:2.0:1789438113.016823:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438113.016884:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991ffbbce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789438113.017052:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769656832 00000100:00100000:1.0:1789438113.017060:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769656832 00000100:00100000:1.0:1789438113.017113:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789438113.017124:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f419aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+3:5854:x1876361769656832:12345-0@lo:104: 00010000:00010000:1.0:1789438113.017136:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff999202045c00/0x7a8dd0fcbb924a9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924aa3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438113.017192:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789438113.017198:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f419aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+3:5854:x1876361769656832:12345-0@lo:104: Request processed in 77us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438113.017204:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789438113.017259:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f419b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1876361769656832:0@lo:104: 00010000:00010000:1.0:1789438113.017279:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff999202045800/0x7a8dd0fcbb924b44 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438113.017450:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789438113.017458:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff999202045c00/0x7a8dd0fcbb924a9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924aa3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438113.017465:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999202045c00 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:0.0:1789438113.017469:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff999202045c00/0x7a8dd0fcbb924a9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb924aa3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438113.017478:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff999202045c00/0x7a8dd0fcbb924a9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb924aa3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789438113.017486:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff999202045c00/0x7a8dd0fcbb924a9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb924aa3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789438113.017509:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789438113.017547:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff999202045c00/0x7a8dd0fcbb924a9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924aa3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438113.017554:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789438113.017574:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff999202045c00/0x7a8dd0fcbb924a9c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924aa3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438113.017582:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff999202045c00/0x7a8dd0fcbb924a9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924aa3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438113.017600:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438113.017602:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438113.017604:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438113.017620:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769656960:0@lo:103: 00000100:00100000:0.0:1789438113.017656:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438113.018077:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769656960 00000100:00100000:3.0:1789438113.018083:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769656960 00010000:00010000:3.0:1789438113.018108:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb924aa3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924a9c expref: 14 pid: 5833 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438113.018138:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789438113.018146:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d0511450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+14:3309:x1876361769656960:12345-0@lo:103: 00010000:00010000:3.0:1789438113.018166:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438113.018171:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb924aa3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924a9c expref: 14 pid: 5833 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438113.018180:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb924aa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924a9c expref: 14 pid: 5833 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438113.018193:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb924aa3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb924a9c expref: 14 pid: 5833 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438113.018207:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff999202045800/0x7a8dd0fcbb924b44 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438113.018286:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff999202045800/0x7a8dd0fcbb924b44 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789438113.018301:0:5822:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002447297s 00010000:00010000:3.0:1789438113.018305:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff999202045800/0x7a8dd0fcbb924b44 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438113.018313:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff999202045800/0x7a8dd0fcbb924b44 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438113.018320:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff999202045800/0x7a8dd0fcbb924b44 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438113.018327:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff999202045800/0x7a8dd0fcbb924b44 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438113.018332:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999202045800 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:3.0:1789438113.018337:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff999202045800/0x7a8dd0fcbb924b44 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438113.018352:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff999202045800/0x7a8dd0fcbb924b44 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438113.018370:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff999202045800/0x7a8dd0fcbb924b44 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438113.018381:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789438113.018426:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d0511450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+13:3309:x1876361769656960:12345-0@lo:103: Request processed in 280us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438113.018433:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789438113.018496:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769656960:0@lo:103: 00010000:00010000:1.0:1789438113.018750:0:5854:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff999202045800/0x7a8dd0fcbb924b44 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438113.018758:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff999202045800/0x7a8dd0fcbb924b44 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438113.018954:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff999202045800/0x7a8dd0fcbb924b44 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438113.021768:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:6677:x1876361769656704:12345-0@lo:253: Request processed in 53153us (56521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438113.021789:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789438113.022040:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:6677:1876361769656704:0@lo:253: 10000000:01000000:0.0:1789438113.022055:0:6677:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789438113.022058:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789438113.022060:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789438113.022061:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789438113.022063:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789438113.022064:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789438113.022065:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789438113.022066:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789438113.022067:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789438113.022069:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789438113.022070:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789438113.022072:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789438113.022084:0:6677:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789438113.037123:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789438113.037871:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789438113.038109:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789438113.038451:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789438113.038659:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789438113.039327:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789438113.042659:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789438113.260747:0:6677:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789438113.260754:0:6677:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789438113.260786:0:6677:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789438113.261167:0:6677:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.109@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789438113.261184:0:6677:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789438113.261251:0:6677:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1789438113.655955:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438114.685189:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789438115.382903:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789438115.382914:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9991d197a000 from 21 10000000:01000000:1.0:1789438115.382921:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789438115.382982:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991e0967e00/0x7a8dd0fcbb924b4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438115.382996:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991e0967e00/0x7a8dd0fcbb924b4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438115.383009:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991e0967e00/0x7a8dd0fcbb924b4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438115.383037:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3756a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769657088:0@lo:101: 00000100:00100000:1.0:1789438115.383499:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438115.383687:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769657088 00000100:00100000:0.0:1789438115.383698:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769657088 00000100:00100000:0.0:1789438115.383783:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789438115.383794:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+12:5836:x1876361769657088:12345-0@lo:101: 00010000:00010000:0.0:1789438115.383812:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438115.383828:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c0030a00/0x7a8dd0fcbb924b52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924b4b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438115.383866:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c0030a00/0x7a8dd0fcbb924b52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924b4b expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438115.383878:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c0030a00/0x7a8dd0fcbb924b52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924b4b expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438115.383888:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c0030a00, rc 0) 00000100:00100000:0.0:1789438115.383930:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+13:5836:x1876361769657088:12345-0@lo:101: Request processed in 138us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438115.383937:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789438115.384024:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e50533c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789438115.384056:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3756a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769657088:0@lo:101: 00010000:00010000:1.0:1789438115.384084:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991e0967e00/0x7a8dd0fcbb924b4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924b52 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438115.384095:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991e0967e00/0x7a8dd0fcbb924b4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924b52 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438115.384802:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3756a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769657216:0@lo:501: 00000100:00100000:1.0:1789438115.384853:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438115.384875:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e50533c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789438115.385289:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769657216 00000100:00100000:0.0:1789438115.385297:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769657216 00000100:00100000:0.0:1789438115.385342:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789438115.385351:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+13:5836:x1876361769657216:12345-0@lo:501: 00000100:00100000:0.0:1789438115.385864:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+13:5836:x1876361769657216:12345-0@lo:501: Request processed in 513us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438115.385872:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789438115.386233:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3756a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769657216:0@lo:501: 00000100:00100000:1.0:1789438115.386279:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3756a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769657344:0@lo:503: 00000100:00100000:1.0:1789438115.386330:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438115.386358:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e50533c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789438115.386972:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769657344 00000100:00100000:0.0:1789438115.386981:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769657344 00000100:00100000:0.0:1789438115.387031:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789438115.387039:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+13:5836:x1876361769657344:12345-0@lo:503: 00000100:00100000:0.0:1789438115.388368:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+13:5836:x1876361769657344:12345-0@lo:503: Request processed in 1319us (2028us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438115.388383:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789438115.388508:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3756a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769657344:0@lo:503: 00000100:00100000:1.0:1789438115.390978:0:6817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3755500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:6817:1876361769657472:0@lo:502: 00000100:00100000:1.0:1789438115.391097:0:6817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438115.391181:0:6817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c4e5aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789438115.391241:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769657472 00000100:00100000:0.0:1789438115.391253:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769657472 00000100:00100000:0.0:1789438115.391313:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789438115.391329:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+13:6817:x1876361769657472:12345-0@lo:502: 00000100:00100000:0.0:1789438115.391844:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+13:6817:x1876361769657472:12345-0@lo:502: Request processed in 509us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438115.391853:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789438115.392084:0:6817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3755500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:6817:1876361769657472:0@lo:502: 00000100:00100000:1.0:1789438115.392152:0:6817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3755500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:6817:1876361769657600:0@lo:502: 00000100:00100000:1.0:1789438115.392192:0:6817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438115.392225:0:6817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f3f74300 going to sleep for 11 seconds 00000100:00100000:0.0:1789438115.392384:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769657600 00000100:00100000:0.0:1789438115.392389:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769657600 00000100:00100000:0.0:1789438115.392425:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789438115.392432:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+13:6817:x1876361769657600:12345-0@lo:502: 00000100:00100000:0.0:1789438115.392586:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+13:6817:x1876361769657600:12345-0@lo:502: Request processed in 154us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438115.392593:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789438115.392668:0:6817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3755500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:6817:1876361769657600:0@lo:502: 00000040:00080000:1.0:1789438115.392688:0:6817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789438115.392930:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789438115.392953:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789438115.392967:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991e0967e00/0x7a8dd0fcbb924b4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924b52 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438115.392981:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991e0967e00/0x7a8dd0fcbb924b4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924b52 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789438115.392992:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789438115.393003:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9991d197a000 from 4 10000000:01000000:0.0:1789438115.393006:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789438115.393040:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c0030600/0x7a8dd0fcbb924b59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438115.393049:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991c0030600/0x7a8dd0fcbb924b59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438115.393071:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991c0030600/0x7a8dd0fcbb924b59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438115.393086:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769657728:0@lo:101: 00000100:00100000:0.0:1789438115.393129:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438115.393152:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c6d5dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789438115.393282:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769657728 00000100:00100000:1.0:1789438115.393287:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769657728 00000100:00100000:1.0:1789438115.393325:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789438115.393340:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+13:5836:x1876361769657728:12345-0@lo:101: 00010000:00010000:1.0:1789438115.393351:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438115.393366:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991e0966e00/0x7a8dd0fcbb924b60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924b59 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438115.393391:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991e0966e00/0x7a8dd0fcbb924b60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924b59 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438115.393403:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991e0966e00/0x7a8dd0fcbb924b60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924b59 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438115.393412:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e0966e00, rc 0) 00000100:00100000:1.0:1789438115.393448:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+14:5836:x1876361769657728:12345-0@lo:101: Request processed in 110us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438115.393454:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789438115.393489:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769657728:0@lo:101: 00010000:00010000:1.0:1789438115.393503:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991c0030600/0x7a8dd0fcbb924b59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924b60 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438115.393514:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991c0030600/0x7a8dd0fcbb924b59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924b60 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438115.393562:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3755500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769657856:0@lo:256: 00000100:00100000:1.0:1789438115.393596:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438115.393618:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f3f74540 going to sleep for 11 seconds 00000100:00100000:1.0:1789438115.393631:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769657856 00000100:00100000:1.0:1789438115.393634:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769657856 00000100:00100000:1.0:1789438115.393656:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789438115.393662:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+14:5836:x1876361769657856:12345-0@lo:256: 20000000:01000000:1.0:1789438115.393682:0:5833:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789438115.393700:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789438115.393703:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789438115.393807:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+14:5836:x1876361769657856:12345-0@lo:256: Request processed in 144us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438115.393814:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789438115.393857:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3755500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769657856:0@lo:256: 10000000:01000000:1.0:1789438115.393898:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789438115.393904:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c0030600/0x7a8dd0fcbb924b59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924b60 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438115.393912:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991c0030600/0x7a8dd0fcbb924b59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924b60 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789438115.393920:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789438115.393922:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1789438115.393925:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789438115.393944:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991e0966400/0x7a8dd0fcbb924b67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438115.393951:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991e0966400/0x7a8dd0fcbb924b67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438115.393960:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991e0966400/0x7a8dd0fcbb924b67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438115.393972:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3755500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769657984:0@lo:101: 00000100:00100000:1.0:1789438115.393996:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438115.394012:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f3f74540 going to sleep for 11 seconds 00000100:00100000:1.0:1789438115.394029:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769657984 00000100:00100000:1.0:1789438115.394033:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769657984 00000100:00100000:1.0:1789438115.394054:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789438115.394801:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+14:5836:x1876361769657984:12345-0@lo:101: 00010000:00010000:1.0:1789438115.394816:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438115.394845:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991e0967400/0x7a8dd0fcbb924b6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924b67 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438115.394869:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991e0967400/0x7a8dd0fcbb924b6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924b67 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438115.394880:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991e0967400/0x7a8dd0fcbb924b6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924b67 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438115.394890:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e0967400, rc 0) 00000100:00100000:1.0:1789438115.394990:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+15:5836:x1876361769657984:12345-0@lo:101: Request processed in 929us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438115.394999:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789438115.395676:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3755500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769657984:0@lo:101: 00010000:00010000:0.0:1789438115.395698:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991e0966400/0x7a8dd0fcbb924b67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924b6e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438115.397433:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991e0966400/0x7a8dd0fcbb924b67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924b6e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438115.397556:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769658112:0@lo:501: 00000100:00100000:0.0:1789438115.397638:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438115.397684:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c6d5d180 going to sleep for 11 seconds 00000100:00100000:0.0:1789438115.397757:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769658112 00000100:00100000:0.0:1789438115.397766:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769658112 00000100:00100000:0.0:1789438115.397822:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789438115.397832:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+15:5836:x1876361769658112:12345-0@lo:501: 00000100:00100000:0.0:1789438115.401542:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+15:5836:x1876361769658112:12345-0@lo:501: Request processed in 3697us (3890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438115.401572:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789438115.403079:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769658112:0@lo:501: 00000100:00100000:3.0:1789438115.403152:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769658240:0@lo:503: 00000100:00100000:3.0:1789438115.403237:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438115.403293:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c5e00240 going to sleep for 11 seconds 00000100:00100000:1.0:1789438115.403767:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769658240 00000100:00100000:1.0:1789438115.403783:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769658240 00000100:00100000:1.0:1789438115.403866:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789438115.403881:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+15:5836:x1876361769658240:12345-0@lo:503: 00000100:00100000:1.0:1789438115.408790:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+15:5836:x1876361769658240:12345-0@lo:503: Request processed in 4900us (5539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438115.408810:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789438115.421535:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769658240:0@lo:503: 00000100:00100000:3.0:1789438115.422027:0:6820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:6820:1876361769658368:0@lo:502: 00000100:00100000:3.0:1789438115.422122:0:6820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438115.422175:0:6820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c5e00f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789438115.422857:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769658368 00000100:00100000:0.0:1789438115.422869:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769658368 00000100:00100000:0.0:1789438115.422935:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789438115.422949:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+15:6820:x1876361769658368:12345-0@lo:502: 00000100:00100000:0.0:1789438115.423556:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+15:6820:x1876361769658368:12345-0@lo:502: Request processed in 607us (1431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438115.423565:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789438115.423614:0:6820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:6820:1876361769658368:0@lo:502: 00000020:01000000:3.0:1789438115.423664:0:6820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789438115.423673:0:6820:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789438115.423691:0:6820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789438115.423693:0:6820:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789438115.423699:0:6820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789438115.423703:0:6820:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.109@tcp to nid 0x20000c0a8ce6d (192.168.206.109@tcp) 00000020:01000000:3.0:1789438115.424285:0:6820:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789438115.424294:0:6820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789438115.424329:0:6820:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9991eb258000) 00000020:00000080:3.0:1789438115.424354:0:6820:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1789438115.424364:0:6820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789438115.424454:0:6820:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789438115.424460:0:6820:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789438115.424480:0:6820:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7a8dd0fcbb924b7c 00010000:00080000:3.0:1789438115.424531:0:6820:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9991eb24a000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.109@tcp at head 00010000:00010000:3.0:1789438115.432362:0:6820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1789438115.528821:0:6820:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789438115.528860:0:6820:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789438115.529484:0:6820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789438115.529653:0:6820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789438115.529910:0:6820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789438115.529986:0:6820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1789438115.533473:0:6824:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789438115.533486:0:6824:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789438115.544095:0:6820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789438115.544116:0:6820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789438115.544168:0:6820:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789438115.544196:0:6820:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7a8dd0fcbb924b83 00000100:00080000:1.0:1789438115.544218:0:6820:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789438115.544235:0:6820:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9991eb24a000 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:1.0:1789438115.544289:0:6820:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9991f3756300 x1876361769658496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789438115.544323:0:6820:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789438115.544401:0:6820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789438115.544406:0:6820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438115.544408:0:6820:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789438115.544412:0:6820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789438115.544417:0:6820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438115.544419:0:6820:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789438115.544422:0:6820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789438115.544424:0:6820:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789438115.544459:0:6820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3754000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:6820:1876361769658624:0@lo:502: 00000100:00100000:1.0:1789438115.544561:0:6820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438115.544617:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769658624 00000100:00100000:1.0:1789438115.544625:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769658624 00000100:00100000:1.0:1789438115.544669:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789438115.544680:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+15:6820:x1876361769658624:12345-0@lo:502: 00000100:00100000:3.0:1789438115.544890:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876361769658496:0@lo:8: 00000100:00100000:3.0:1789438115.544952:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438115.545030:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769658496 00000100:00100000:3.0:1789438115.545035:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769658496 00000100:00100000:3.0:1789438115.545059:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789438115.545065:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1876361769658496:12345-0@lo:8: 00010000:00080000:3.0:1789438115.545088:0:6680:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:3.0:1789438115.545123:0:6680:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7a8dd0fcbb924b8a 00002000:00100000:3.0:1789438115.545163:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9991eb248000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789438115.545168:0:6680:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1789438115.545172:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1789438115.545324:0:6680:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789438115.545500:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789438115.545530:0:6680:0:(import.c:65:import_set_state_nolock()) ffff9991eb24f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789438115.545594:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1876361769658496:12345-0@lo:8: Request processed in 528us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438115.545602:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789438115.545660:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991f3756300 x1876361769658496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789438125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438115.545673:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789438115.545683:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789438115.545694:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789438115.545700:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789438115.545702:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9991eb24a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789438115.545746:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789438115.545753:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876361769658496:0@lo:8: 00000004:00080000:3.0:1789438115.546605:0:6824:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789438115.546803:0:6824:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 167812094491ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789438115.548414:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f4199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876361769658752:0@lo:400: 00000100:00100000:2.0:1789438115.548505:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438115.548577:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f419a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769658880:0@lo:400: 00000100:00100000:2.0:1789438115.548603:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438115.548662:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769658752 00000100:00100000:2.0:1789438115.548671:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769658752 00000100:00100000:2.0:1789438115.548738:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769658880 00000100:00100000:2.0:1789438115.548741:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769658880 00000100:00100000:2.0:1789438115.548791:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789438115.548800:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876361769658752:12345-0@lo:400: 00000100:00100000:2.0:1789438115.548876:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876361769658752:12345-0@lo:400: Request processed in 76us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438115.548884:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789438115.548903:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789438115.548909:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769658880:12345-0@lo:400: 00000100:00100000:2.0:1789438115.548941:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769658880:12345-0@lo:400: Request processed in 33us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438115.548947:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789438115.549001:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991f419a300 x1876361769658880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438115.549017:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f419a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769658880:0@lo:400: 00010000:00080000:2.0:1789438115.549046:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991f4199500 x1876361769658752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438115.549054:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f4199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876361769658752:0@lo:400: 00000100:00080000:1.0:1789438115.549345:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789438115.549579:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+15:6820:x1876361769658624:12345-0@lo:502: Request processed in 4899us (5016us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438115.549589:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789438115.549650:0:6820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f3f74540 going to sleep for 11 seconds 00000100:00100000:1.0:1789438115.549667:0:6820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3754000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:6820:1876361769658624:0@lo:502: 00000020:01000000:1.0:1789438115.549702:0:6820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789438115.549742:0:6820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438115.549744:0:6820:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789438115.549751:0:6820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1789438115.554014:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1789438115.554061:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789438115.554075:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991e0966400/0x7a8dd0fcbb924b67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924b6e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438115.554091:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991e0966400/0x7a8dd0fcbb924b67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924b6e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789438115.554104:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789438115.554107:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9991e1e54d40 from 1 10000000:01000000:0.0:1789438115.554109:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789438115.554159:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c0030e00/0x7a8dd0fcbb924b91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438115.554187:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991c0030e00/0x7a8dd0fcbb924b91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438115.554201:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991c0030e00/0x7a8dd0fcbb924b91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438115.554233:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769659008:0@lo:101: 00000100:00100000:0.0:1789438115.554318:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438115.554403:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c6d5df00 going to sleep for 11 seconds 00000100:00100000:1.0:1789438115.555901:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769659008 00000100:00100000:1.0:1789438115.555918:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769659008 00000100:00100000:1.0:1789438115.555978:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789438115.555989:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+15:5836:x1876361769659008:12345-0@lo:101: 00010000:00010000:1.0:1789438115.556010:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438115.556031:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991e0967800/0x7a8dd0fcbb924b98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924b91 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438115.556065:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991e0967800/0x7a8dd0fcbb924b98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924b91 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438115.556077:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991e0967800/0x7a8dd0fcbb924b98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924b91 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438115.556087:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e0967800, rc 0) 00000100:00100000:1.0:1789438115.556175:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+16:5836:x1876361769659008:12345-0@lo:101: Request processed in 187us (1856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438115.556182:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789438115.556280:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769659008:0@lo:101: 00010000:00010000:0.0:1789438115.556300:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991c0030e00/0x7a8dd0fcbb924b91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924b98 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438115.556311:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991c0030e00/0x7a8dd0fcbb924b91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924b98 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438115.556384:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769659136:0@lo:501: 00000100:00100000:0.0:1789438115.556416:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438115.556452:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c6d5df00 going to sleep for 11 seconds 00000100:00100000:2.0:1789438115.556509:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769659136 00000100:00100000:2.0:1789438115.556514:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769659136 00000100:00100000:2.0:1789438115.556600:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789438115.556624:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+16:5836:x1876361769659136:12345-0@lo:501: 00000100:00100000:2.0:1789438115.556956:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+16:5836:x1876361769659136:12345-0@lo:501: Request processed in 333us (537us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789438115.556964:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789438115.557301:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769659136:0@lo:501: 10000000:01000000:0.0:1789438115.557333:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789438115.557341:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c0030e00/0x7a8dd0fcbb924b91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924b98 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438115.557352:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991c0030e00/0x7a8dd0fcbb924b91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924b98 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789438115.580213:0:6825:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789438115.580260:0:6825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06f9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6825:1876361769659392:0@lo:7: 00000100:00100000:3.0:1789438115.580346:0:6825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438115.580401:0:6825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c6cbe840 going to sleep for 11 seconds 00000100:00100000:2.0:1789438115.582024:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769659264:0@lo:13: 00000100:00100000:2.0:1789438115.582131:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438115.582222:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769659392 00000100:00100000:2.0:1789438115.582233:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769659392 00000100:00100000:2.0:1789438115.582307:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789438115.582317:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6825:x1876361769659392:12345-0@lo:7: 00000100:00100000:0.0:1789438115.582906:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769659264 00000100:00100000:0.0:1789438115.582913:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769659264 00000100:00100000:0.0:1789438115.582953:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789438115.582961:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1876361769659264:12345-0@lo:13: 00002000:00000024:0.0:1789438115.582990:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1789438115.583068:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1876361769659264:12345-0@lo:13: Request processed in 107us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438115.583076:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789438115.583249:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1789438115.589579:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1789438115.589590:0:6682:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789438115.589755:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6825:x1876361769659392:12345-0@lo:7: Request processed in 7432us (9401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438115.589767:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789438115.589933:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991e06f8a80 x1876361769659264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438131 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789438115.589968:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769659264:0@lo:13: 00010000:00080000:3.0:1789438115.594466:0:6825:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991e06f9180 x1876361769659392/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789438131 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438115.594491:0:6825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06f9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6825:1876361769659392:0@lo:7: 00000004:00080000:3.0:1789438115.594525:0:6825:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789438115.594582:0:6825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06f9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6825:1876361769659520:0@lo:5: 00000100:00100000:3.0:1789438115.594681:0:6825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438115.594779:0:6825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c6cbe840 going to sleep for 11 seconds 00000100:00100000:3.0:1789438115.594813:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769659520 00000100:00100000:3.0:1789438115.594820:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769659520 00000100:00100000:3.0:1789438115.594886:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789438115.594896:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6825:x1876361769659520:12345-0@lo:5: 00002000:00080000:3.0:1789438115.594927:0:6681:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789438115.594932:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1789438115.595365:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6825:x1876361769659520:12345-0@lo:5: Request processed in 468us (683us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789438115.595372:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789438115.595417:0:6825:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991e06f9180 x1876361769659520/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789438131 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438115.595432:0:6825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06f9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6825:1876361769659520:0@lo:5: 00000004:00080000:3.0:1789438115.595442:0:6825:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789438115.595474:0:6825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06fad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6825:1876361769659648:0@lo:700: 00000100:00100000:3.0:1789438115.595503:0:6825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438115.595521:0:6825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c6cbe840 going to sleep for 11 seconds 00000100:00100000:2.0:1789438115.595821:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769659648 00000100:00100000:2.0:1789438115.595828:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769659648 00000100:00100000:2.0:1789438115.595877:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789438115.595886:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6825:x1876361769659648:12345-0@lo:700: 00000100:00100000:2.0:1789438115.595924:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f419a300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6688:1876361769659776:0@lo:700: 00000100:00100000:2.0:1789438115.595959:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438115.596250:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991ffbbca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789438115.602296:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769659776 00000100:00100000:1.0:1789438115.602317:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769659776 00000100:00100000:1.0:1789438115.602398:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789438115.602411:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f419bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6688:x1876361769659776:12345-0@lo:700: 00000004:00080000:2.0:1789438115.639157:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:0.0:1789438115.699459:0:5845:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00010000:00010000:2.0:1789438115.711321:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438115.711468:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f419bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6688:x1876361769659776:12345-0@lo:700: Request processed in 109051us (115499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438115.711484:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789438115.711603:0:6688:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991f419a300 x1876361769659776/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789438131 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438115.711623:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f419a300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6688:1876361769659776:0@lo:700: 40000000:02000000:2.0:1789438115.711640:0:6688:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1789438115.821323:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1789438115.821344:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789438115.821677:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6825:x1876361769659648:12345-0@lo:700: Request processed in 225785us (226165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438115.821771:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789438115.824222:0:6825:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991e06fad80 x1876361769659648/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789438131 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438115.824240:0:6825:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789438115.824263:0:6825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06fad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6825:1876361769659648:0@lo:700: 00000004:02000040:0.0:1789438115.874197:0:6825:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1789438115.882431:0:6825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3754000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6825:1876361769659904:0@lo:5: 00000100:00100000:1.0:1789438115.882536:0:6825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438115.882622:0:6825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e1d45300 going to sleep for 11 seconds 00000100:00100000:2.0:1789438115.883701:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769659904 00000100:00100000:2.0:1789438115.883729:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769659904 00000100:00100000:2.0:1789438115.883807:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789438115.883824:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6825:x1876361769659904:12345-0@lo:5: 00002000:00080000:2.0:1789438115.892306:0:6681:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1789438115.892336:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1789438115.898623:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6825:x1876361769659904:12345-0@lo:5: Request processed in 14792us (16077us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789438115.898639:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789438115.901114:0:6825:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991f3754000 x1876361769659904/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789438131 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438115.901142:0:6825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3754000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6825:1876361769659904:0@lo:5: 00000004:00080000:3.0:1789438115.901173:0:6825:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1789438116.729289:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438117.757321:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438118.775002:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438119.798884:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789438120.111691:0:7049:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg609-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789438120.760124:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876361769660160:0@lo:400: 00000100:00100000:1.0:1789438120.760193:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438120.760245:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789438120.760251:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769660032:0@lo:400: 00000100:00100000:1.0:1789438120.760276:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438120.760302:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769660288:0@lo:400: 00000100:00100000:1.0:1789438120.760327:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438120.760341:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789438120.760345:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769660416:0@lo:400: 00000100:00100000:1.0:1789438120.760366:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438120.760396:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769660160 00000100:00100000:1.0:1789438120.760403:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769660160 00000100:00100000:1.0:1789438120.760443:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769660288 00000100:00100000:1.0:1789438120.760446:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769660288 00000100:00100000:1.0:1789438120.760472:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789438120.760479:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876361769660160:12345-0@lo:400: 00000100:00100000:1.0:1789438120.760526:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876361769660160:12345-0@lo:400: Request processed in 47us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438120.760533:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789438120.760548:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789438120.760554:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769660288:12345-0@lo:400: 00000100:00100000:1.0:1789438120.760583:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769660288:12345-0@lo:400: Request processed in 29us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438120.760594:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1789438120.760615:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789438120.760643:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991f3754a80 x1876361769660288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789438120.760656:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769660288:0@lo:400: 00010000:00080000:1.0:1789438120.760682:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991f3755c00 x1876361769660160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789438120.760691:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876361769660160:0@lo:400: 00000100:00100000:0.0:1789438120.760992:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769660032 00000100:00100000:0.0:1789438120.760998:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769660032 00000100:00100000:0.0:1789438120.761026:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789438120.761032:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+16:3310:x1876361769660032:12345-0@lo:400: 00000100:00100000:0.0:1789438120.761068:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+16:3310:x1876361769660032:12345-0@lo:400: Request processed in 36us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438120.761074:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789438120.761566:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769660032:0@lo:400: 00000100:00100000:1.0:1789438120.761582:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789438120.761589:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769660544:0@lo:13: 00000100:00100000:1.0:1789438120.761616:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438120.761685:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769660544 00000100:00100000:0.0:1789438120.761690:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769660544 00000100:00080000:1.0:1789438120.761843:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789438120.761898:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789438120.761907:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1876361769660544:12345-0@lo:13: 00002000:00000024:0.0:1789438120.762012:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438120.762056:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1876361769660544:12345-0@lo:13: Request processed in 151us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438120.762062:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789438120.762092:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991c7e8f100 x1876361769660544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438136 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438120.762108:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769660544:0@lo:13: 00000100:00100000:2.0:1789438120.762987:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769660416 00000100:00100000:2.0:1789438120.762994:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769660416 00000100:00100000:2.0:1789438120.763034:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789438120.763042:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1876361769660416:12345-0@lo:400: 00000100:00100000:2.0:1789438120.763114:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1876361769660416:12345-0@lo:400: Request processed in 73us (2746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438120.763120:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789438120.763153:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991f3755180 x1876361769660416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438120.763165:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769660416:0@lo:400: 00010000:00010000:0.0:1789438120.824901:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789438120.894751:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1789438121.848828:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438122.874248:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438123.895153:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438124.926755:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438125.880541:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769660672:0@lo:13: 00000100:00100000:3.0:1789438125.880614:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438125.880838:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769660672 00000100:00100000:0.0:1789438125.880846:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769660672 00000100:00100000:0.0:1789438125.880895:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789438125.880904:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769660672:12345-0@lo:13: 00002000:00000024:0.0:1789438125.880934:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438125.880976:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769660672:12345-0@lo:13: Request processed in 73us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438125.880982:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789438125.881038:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789438125.881065:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991c7e8f100 x1876361769660672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438125.881075:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789438125.881093:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769660672:0@lo:13: 00000100:00100000:2.0:1789438125.885863:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f4199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876361769660928:0@lo:400: 00000100:00100000:2.0:1789438125.885925:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438125.885959:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789438125.885965:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f419a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769660800:0@lo:400: 00000100:00100000:2.0:1789438125.885989:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438125.886023:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769660928 00000100:00100000:2.0:1789438125.886029:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769660928 00000100:00100000:2.0:1789438125.886071:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789438125.886080:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f419b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876361769660928:12345-0@lo:400: 00000100:00100000:2.0:1789438125.886133:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f419b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876361769660928:12345-0@lo:400: Request processed in 55us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438125.886141:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789438125.886163:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769660800 00000100:00100000:2.0:1789438125.886166:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769660800 00000100:00100000:2.0:1789438125.886188:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789438125.886207:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+16:3312:x1876361769660800:12345-0@lo:400: 00000100:00100000:2.0:1789438125.886353:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+16:3312:x1876361769660800:12345-0@lo:400: Request processed in 159us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438125.886360:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789438125.886405:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f419a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769660800:0@lo:400: 00010000:00080000:2.0:1789438125.886418:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991f4199c00 x1876361769660928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438125.886430:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f4199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876361769660928:0@lo:400: 00000100:00100000:2.0:1789438125.886452:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789438125.886461:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f419ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876361769661056:0@lo:400: 00000100:00100000:2.0:1789438125.886483:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438125.886507:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769661056 00000100:00100000:2.0:1789438125.886511:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769661056 00000100:00100000:2.0:1789438125.886537:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789438125.886542:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876361769661056:12345-0@lo:400: 00000100:00100000:2.0:1789438125.886573:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876361769661056:12345-0@lo:400: Request processed in 31us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438125.886580:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1789438125.886595:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789438125.886611:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991f419ad80 x1876361769661056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438125.886628:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f419ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876361769661056:0@lo:400: 00010000:00010000:3.0:1789438125.943908:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438126.969132:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438127.992808:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438129.015108:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438130.039193:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789438130.161329:0:7608:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789438130.161333:0:7608:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1789438130.161436:0:7608:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9991ffa93000 00000020:01000004:2.0:1789438130.161450:0:7608:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789438130.161462:0:7608:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789438130.161486:0:7608:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9991ff9999c0) 00000020:00000080:2.0:1789438130.161501:0:7608:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789438130.214186:0:7608:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789438130.214434:0:7608:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789438130.256748:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789438130.262946:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789438130.262977:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789438130.263032:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789438130.263055:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789438130.263382:0:7608:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789438130.263394:0:7608:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789438130.263404:0:7608:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7a8dd0fcbb924ba6 00000020:01000004:3.0:1789438130.263412:0:7608:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789438130.263432:0:7608:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.109@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789438130.263441:0:7608:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789438130.263447:0:7608:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789438130.263470:0:7608:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789438130.263474:0:7608:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.109@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789438130.315357:0:7608:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.109@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789438130.315404:0:7608:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.109@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1789438130.315409:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789438130.315411:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789438130.315412:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789438130.315413:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789438130.315415:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789438130.315416:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789438130.315417:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789438130.315419:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789438130.315420:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789438130.315422:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789438130.315423:0:7608:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789438130.315427:0:7608:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1789438130.315429:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789438130.315431:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789438130.315432:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789438130.315433:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789438130.315434:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789438130.315435:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789438130.315436:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789438130.315437:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789438130.315438:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789438130.315439:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789438130.315440:0:7608:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789438130.315469:0:7608:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789438130.315489:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769661184:0@lo:253: 00000100:00100000:3.0:1789438130.315576:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438130.315630:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c5e00600 going to sleep for 11 seconds 00000100:00100000:0.0:1789438130.315927:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769661184 00000100:00100000:0.0:1789438130.315936:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769661184 00000100:00100000:0.0:1789438130.315986:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789438130.315995:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1facc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+16:7608:x1876361769661184:12345-0@lo:253: 20000000:01000000:0.0:1789438130.316022:0:5832:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789438130.316026:0:5832:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789438130.316030:0:5832:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789438130.316034:0:5832:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1789438130.317047:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789438130.317247:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1789438130.317260:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1789438130.317305:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1789438130.317313:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1789438130.317351:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1789438130.317402:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1789438130.317686:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1789438130.317704:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.109@tcp 20000000:01000000:0.0:1789438130.317731:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.109@tcp (null) (null) (null) 00000040:00080000:0.0:1789438130.317781:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1789438130.317790:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789438130.317835:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1789438130.317842:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.109@tcp (null) (null) 00000040:00080000:0.0:1789438130.317872:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1789438130.317880:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789438130.317906:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1789438130.317950:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1789438130.318580:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1789438130.318598:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.109@tcp 20000000:01000000:0.0:1789438130.318600:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.109@tcp (null) (null) (null) 00000040:00080000:0.0:1789438130.318634:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1789438130.318641:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789438130.318671:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1789438130.318678:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.109@tcp (null) (null) 00000040:00080000:1.0:1789438130.320347:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1789438130.320371:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789438130.320470:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1789438130.320513:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1789438130.320590:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1789438130.320593:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1789438130.320598:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789438130.320600:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789438130.320602:0:5832:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789438130.320615:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789438130.320617:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789438130.320761:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789438130.320785:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789438130.321348:0:7610:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1789438130.321417:0:7610:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1789438130.321475:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1789438130.322152:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1789438130.322194:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1789438130.322229:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1789438130.322241:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789438130.322244:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789438130.323062:0:7611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1789438130.323305:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1789438130.323346:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1789438130.323422:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1789438130.323435:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789438130.323437:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789438130.325870:0:7612:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1789438130.325955:0:7612:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1789438130.326031:0:7612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1789438130.326350:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1789438130.326392:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1789438130.326452:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1789438130.326465:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789438130.326467:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789438130.327235:0:7613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1789438130.327304:0:7613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1789438130.327337:0:7613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1789438130.327635:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1789438130.327826:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1789438130.327873:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:1.0:1789438130.327888:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789438130.327906:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9991ff9da600/0x7a8dd0fcbb924bad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438130.327922:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991e0967000/0x7a8dd0fcbb924afe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924af7 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438130.327930:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991c2a54a00/0x7a8dd0fcbb924b28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924b21 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438130.327937:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991c0030a00/0x7a8dd0fcbb924b52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924b4b expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438130.327944:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991e0967400/0x7a8dd0fcbb924b6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924b67 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438130.327960:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991e0967800/0x7a8dd0fcbb924b98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924b91 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438130.327967:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9991ff9da600/0x7a8dd0fcbb924bad lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438130.328000:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991e0967800/0x7a8dd0fcbb924b98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb924b91 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438130.328013:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9991e0967800/0x7a8dd0fcbb924b98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b91 expref: 16 pid: 5833 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438130.328025:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3755c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1876361769661312:0@lo:104: 00000100:00100000:1.0:1789438130.328078:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789438130.328114:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991e0967400/0x7a8dd0fcbb924b6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb924b67 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438130.328121:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9991e0967400/0x7a8dd0fcbb924b6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b67 expref: 16 pid: 5833 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438130.328129:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3754a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1876361769661440:0@lo:104: 00010000:00010000:1.0:1789438130.328147:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991c0030a00/0x7a8dd0fcbb924b52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb924b4b expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438130.328155:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9991c0030a00/0x7a8dd0fcbb924b52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b4b expref: 16 pid: 5833 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438130.328161:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3756a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1876361769661568:0@lo:104: 00010000:00010000:1.0:1789438130.328176:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991c2a54a00/0x7a8dd0fcbb924b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb924b21 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438130.328189:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9991c2a54a00/0x7a8dd0fcbb924b28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b21 expref: 16 pid: 5833 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438130.328197:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3757100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1876361769661696:0@lo:104: 00010000:00010000:1.0:1789438130.328216:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991e0967000/0x7a8dd0fcbb924afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb924af7 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438130.328223:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9991e0967000/0x7a8dd0fcbb924afe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924af7 expref: 16 pid: 5832 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438130.328230:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3754e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1876361769661824:0@lo:104: 00000100:00100000:1.0:1789438130.328241:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e75509c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789438130.328316:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789438130.328333:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438130.328354:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438130.328373:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438130.328380:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438130.328389:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769661312 00000100:00100000:0.0:1789438130.328395:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769661312 00000100:00100000:0.0:1789438130.328423:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769661440 00000100:00100000:0.0:1789438130.328425:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769661440 00000100:00100000:0.0:1789438130.328439:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769661568 00000100:00100000:0.0:1789438130.328441:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769661568 00000100:00100000:0.0:1789438130.328448:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769661696 00000100:00100000:0.0:1789438130.328449:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769661696 00000100:00100000:0.0:1789438130.328456:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769661824 00000100:00100000:0.0:1789438130.328458:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769661824 00000100:00100000:0.0:1789438130.328468:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789438130.328475:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d05cf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+7:5832:x1876361769661312:12345-0@lo:104: 00010000:00010000:0.0:1789438130.328485:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9991c0030e00/0x7a8dd0fcbb924b91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924b98 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.328578:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789438130.328585:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d05cf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+7:5832:x1876361769661312:12345-0@lo:104: Request processed in 110us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438130.328591:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789438130.328639:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789438130.328656:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+6:5832:x1876361769661440:12345-0@lo:104: 00010000:00010000:0.0:1789438130.328663:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9991e0966400/0x7a8dd0fcbb924b67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924b6e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.328693:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789438130.328698:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+6:5832:x1876361769661440:12345-0@lo:104: Request processed in 43us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438130.328703:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789438130.328739:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789438130.328745:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+5:5832:x1876361769661568:12345-0@lo:104: 00010000:00010000:0.0:1789438130.328751:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9991e0967e00/0x7a8dd0fcbb924b4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924b52 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.328803:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789438130.328808:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+5:5832:x1876361769661568:12345-0@lo:104: Request processed in 64us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438130.328814:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789438130.328824:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789438130.328829:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+4:5832:x1876361769661696:12345-0@lo:104: 00010000:00010000:0.0:1789438130.328836:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924b21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924b28 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.328854:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789438130.328859:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+4:5832:x1876361769661696:12345-0@lo:104: Request processed in 30us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438130.328864:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789438130.328873:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789438130.328877:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+3:5832:x1876361769661824:12345-0@lo:104: 00010000:00010000:0.0:1789438130.328883:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9991e0966c00/0x7a8dd0fcbb924af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924afe expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.328900:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1789438130.328904:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+3:5832:x1876361769661824:12345-0@lo:104: Request processed in 27us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438130.328910:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1789438130.328923:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789438130.328928:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991c0030e00/0x7a8dd0fcbb924b91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924b98 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.328935:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c0030e00 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:0.0:1789438130.328943:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991c0030e00/0x7a8dd0fcbb924b91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb924b98 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.328951:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991c0030e00/0x7a8dd0fcbb924b91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb924b98 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789438130.328958:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991c0030e00/0x7a8dd0fcbb924b91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb924b98 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789438130.328964:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789438130.328989:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991c0030e00/0x7a8dd0fcbb924b91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924b98 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.328995:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789438130.329009:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991c0030e00/0x7a8dd0fcbb924b91 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924b98 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329016:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991c0030e00/0x7a8dd0fcbb924b91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924b98 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329027:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789438130.329030:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991e0966400/0x7a8dd0fcbb924b67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924b6e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329036:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0966400 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:0.0:1789438130.329039:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991e0966400/0x7a8dd0fcbb924b67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb924b6e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329045:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991e0966400/0x7a8dd0fcbb924b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb924b6e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789438130.329059:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991e0966400/0x7a8dd0fcbb924b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb924b6e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789438130.329064:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789438130.329074:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991e0966400/0x7a8dd0fcbb924b67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924b6e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329078:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789438130.329089:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991e0966400/0x7a8dd0fcbb924b67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924b6e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329096:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991e0966400/0x7a8dd0fcbb924b67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924b6e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329106:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789438130.329108:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991e0967e00/0x7a8dd0fcbb924b4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924b52 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329114:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0967e00 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:0.0:1789438130.329117:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991e0967e00/0x7a8dd0fcbb924b4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb924b52 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329123:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991e0967e00/0x7a8dd0fcbb924b4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb924b52 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789438130.329129:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991e0967e00/0x7a8dd0fcbb924b4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb924b52 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789438130.329134:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789438130.329148:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991e0967e00/0x7a8dd0fcbb924b4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924b52 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329153:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789438130.329158:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991e0967e00/0x7a8dd0fcbb924b4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924b52 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329164:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991e0967e00/0x7a8dd0fcbb924b4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924b52 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329171:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789438130.329174:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924b21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924b28 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329179:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c0031400 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:0.0:1789438130.329182:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924b21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb924b28 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329189:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924b21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb924b28 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789438130.329195:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924b21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb924b28 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789438130.329200:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789438130.329207:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924b21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924b28 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329211:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789438130.329215:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924b21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924b28 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329229:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924b21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924b28 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329236:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789438130.329239:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991e0966c00/0x7a8dd0fcbb924af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924afe expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329244:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0966c00 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:0.0:1789438130.329247:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991e0966c00/0x7a8dd0fcbb924af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb924afe expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329252:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991e0966c00/0x7a8dd0fcbb924af7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb924afe expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789438130.329258:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991e0966c00/0x7a8dd0fcbb924af7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb924afe expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789438130.329262:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789438130.329273:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991e0966c00/0x7a8dd0fcbb924af7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924afe expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329278:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789438130.329282:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991e0966c00/0x7a8dd0fcbb924af7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924afe expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329289:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991e0966c00/0x7a8dd0fcbb924af7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924afe expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329300:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438130.329305:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438130.329307:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438130.329313:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438130.329331:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769661952:0@lo:103: 00000100:00100000:0.0:1789438130.329359:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438130.329376:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769662464:0@lo:103: 00000100:00100000:0.0:1789438130.329390:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438130.329403:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789438130.329407:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769662336:0@lo:103: 00000100:00100000:0.0:1789438130.329420:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438130.329440:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769662080:0@lo:103: 00000100:00100000:0.0:1789438130.329456:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438130.329464:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789438130.329468:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769662208:0@lo:103: 00000100:00100000:0.0:1789438130.329481:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438130.329500:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769661952 00000100:00100000:0.0:1789438130.329504:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769661952 00010000:00010000:0.0:1789438130.329520:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991e0967800/0x7a8dd0fcbb924b98 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b91 expref: 17 pid: 5833 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438130.329533:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769662464 00000100:00100000:0.0:1789438130.329535:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769662464 00010000:00010000:0.0:1789438130.329542:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991e0967000/0x7a8dd0fcbb924afe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924af7 expref: 18 pid: 5832 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438130.329550:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769662336 00000100:00100000:0.0:1789438130.329552:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769662336 00010000:00010000:0.0:1789438130.329558:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991c2a54a00/0x7a8dd0fcbb924b28 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b21 expref: 19 pid: 5833 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438130.329576:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769662080 00000100:00100000:0.0:1789438130.329578:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769662080 00010000:00010000:0.0:1789438130.329586:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991e0967400/0x7a8dd0fcbb924b6e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b67 expref: 20 pid: 5833 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438130.329593:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769662208 00000100:00100000:0.0:1789438130.329595:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769662208 00010000:00010000:0.0:1789438130.329601:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991c0030a00/0x7a8dd0fcbb924b52 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b4b expref: 21 pid: 5833 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438130.329611:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789438130.329615:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+21:3310:x1876361769661952:12345-0@lo:103: 00010000:00010000:0.0:1789438130.329624:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438130.329629:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991e0967800/0x7a8dd0fcbb924b98 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b91 expref: 21 pid: 5833 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329638:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991e0967800/0x7a8dd0fcbb924b98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b91 expref: 21 pid: 5833 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329651:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438130.329675:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+21:3310:x1876361769661952:12345-0@lo:103: Request processed in 60us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438130.329681:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789438130.329691:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789438130.329695:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+20:3310:x1876361769662464:12345-0@lo:103: 00010000:00010000:0.0:1789438130.329701:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438130.329705:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991e0967000/0x7a8dd0fcbb924afe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924af7 expref: 20 pid: 5832 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329740:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991e0967000/0x7a8dd0fcbb924afe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924af7 expref: 20 pid: 5832 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329749:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438130.329783:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+20:3310:x1876361769662464:12345-0@lo:103: Request processed in 86us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438130.329788:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789438130.329801:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789438130.329806:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3310:x1876361769662336:12345-0@lo:103: 00010000:00010000:0.0:1789438130.329813:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438130.329816:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991c2a54a00/0x7a8dd0fcbb924b28 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b21 expref: 19 pid: 5833 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329825:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991c2a54a00/0x7a8dd0fcbb924b28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b21 expref: 19 pid: 5833 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329833:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438130.329849:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3310:x1876361769662336:12345-0@lo:103: Request processed in 43us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438130.329854:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789438130.329863:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789438130.329867:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+18:3311:x1876361769662080:12345-0@lo:103: 00010000:00010000:0.0:1789438130.329873:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438130.329876:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991e0967400/0x7a8dd0fcbb924b6e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b67 expref: 18 pid: 5833 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329884:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991e0967400/0x7a8dd0fcbb924b6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b67 expref: 18 pid: 5833 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329897:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438130.329918:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+18:3311:x1876361769662080:12345-0@lo:103: Request processed in 51us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438130.329924:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789438130.329933:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789438130.329938:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+17:3311:x1876361769662208:12345-0@lo:103: 00010000:00010000:0.0:1789438130.329944:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438130.329948:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991c0030a00/0x7a8dd0fcbb924b52 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b4b expref: 17 pid: 5833 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329956:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991c0030a00/0x7a8dd0fcbb924b52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b4b expref: 17 pid: 5833 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329966:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9991ff9da600/0x7a8dd0fcbb924bad lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329974:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991ff9da600/0x7a8dd0fcbb924bad lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329986:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9991ff9da600/0x7a8dd0fcbb924bad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.329993:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9991ff9da600/0x7a8dd0fcbb924bad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.330001:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9991ff9da600/0x7a8dd0fcbb924bad lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.330007:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9991ff9da600/0x7a8dd0fcbb924bad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.330019:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9da600 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:0.0:1789438130.330023:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9991ff9da600/0x7a8dd0fcbb924bad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.330031:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9991ff9da600/0x7a8dd0fcbb924bad lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.330038:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9991ff9da600/0x7a8dd0fcbb924bad lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.330046:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438130.330063:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+17:3311:x1876361769662208:12345-0@lo:103: Request processed in 125us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438130.330069:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789438130.330102:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769662208:0@lo:103: 00000100:00100000:0.0:1789438130.330109:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769662080:0@lo:103: 00000100:00100000:0.0:1789438130.330130:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769662336:0@lo:103: 00000100:00100000:0.0:1789438130.330137:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769661952:0@lo:103: 00000100:00100000:0.0:1789438130.330142:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769662464:0@lo:103: 00010000:00010000:3.0:1789438130.330626:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991e0967800/0x7a8dd0fcbb924b98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b91 expref: 16 pid: 5833 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438130.330691:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3755c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1876361769661312:0@lo:104: 00010000:00010000:2.0:1789438130.330787:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991e0967400/0x7a8dd0fcbb924b6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b67 expref: 15 pid: 5833 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438130.330796:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3754a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1876361769661440:0@lo:104: 00010000:00010000:2.0:1789438130.330805:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c0030a00/0x7a8dd0fcbb924b52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b4b expref: 14 pid: 5833 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438130.330811:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3756a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1876361769661568:0@lo:104: 00010000:00010000:2.0:1789438130.330819:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c2a54a00/0x7a8dd0fcbb924b28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b21 expref: 13 pid: 5833 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438130.330825:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3757100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1876361769661696:0@lo:104: 00010000:00010000:2.0:1789438130.330833:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991e0967000/0x7a8dd0fcbb924afe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb924af7 expref: 12 pid: 5832 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438130.330856:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3754e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1876361769661824:0@lo:104: 00010000:00010000:2.0:1789438130.330875:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9991ff9da600/0x7a8dd0fcbb924bad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438130.330883:0:5832:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9991ff9da600/0x7a8dd0fcbb924bad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438130.330888:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9991ff9da600/0x7a8dd0fcbb924bad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438130.330893:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991ff9da600/0x7a8dd0fcbb924bad lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789438130.330905:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789438130.447088:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1facc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+11:7608:x1876361769661184:12345-0@lo:253: Request processed in 131085us (131503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438130.447103:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789438130.447216:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769661184:0@lo:253: 10000000:01000000:3.0:1789438130.447231:0:7608:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789438130.447235:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789438130.447236:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789438130.447238:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789438130.447239:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1789438130.447240:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789438130.447241:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789438130.447243:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789438130.447244:0:7608:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789438130.447246:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789438130.447247:0:7608:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789438130.447267:0:7608:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9991ffa93000 from lustre-OST0001 10000000:01000000:3.0:1789438130.447294:0:7608:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789438130.447297:0:7608:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789438130.447305:0:7608:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9991e1e54d40 local copy 10000000:01000000:3.0:1789438130.447309:0:7608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789438130.447342:0:7608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c2a54600/0x7a8dd0fcbb924bb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438130.447354:0:7608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.109@tcp lock: ffff9991c2a54600/0x7a8dd0fcbb924bb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438130.447364:0:7608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991c2a54600/0x7a8dd0fcbb924bb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438130.447399:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769662592:0@lo:101: 00000100:00100000:3.0:1789438130.447436:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438130.447486:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f12f6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789438130.447546:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769662592 00000100:00100000:2.0:1789438130.447553:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769662592 00000100:00100000:2.0:1789438130.447598:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789438130.447607:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+11:7608:x1876361769662592:12345-0@lo:101: 00010000:00010000:2.0:1789438130.447620:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438130.447633:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff999202045800/0x7a8dd0fcbb924bbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924bb4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438130.447669:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff999202045800/0x7a8dd0fcbb924bbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924bb4 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438130.447680:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff999202045800/0x7a8dd0fcbb924bbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924bb4 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438130.447696:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999202045800, rc 0) 00000100:00100000:2.0:1789438130.447753:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+12:7608:x1876361769662592:12345-0@lo:101: Request processed in 148us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438130.447760:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789438130.447926:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769662592:0@lo:101: 00010000:00010000:1.0:1789438130.447939:0:7608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991c2a54600/0x7a8dd0fcbb924bb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x7a8dd0fcbb924bbb expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438130.447948:0:7608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991c2a54600/0x7a8dd0fcbb924bb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7a8dd0fcbb924bbb expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438130.448041:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3757800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769662720:0@lo:501: 00000100:00100000:1.0:1789438130.448069:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438130.448099:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e75500c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438130.448156:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769662720 00000100:00100000:3.0:1789438130.448161:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769662720 00000100:00100000:3.0:1789438130.448194:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789438130.448201:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+12:7608:x1876361769662720:12345-0@lo:501: 00000100:00100000:3.0:1789438130.448388:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+12:7608:x1876361769662720:12345-0@lo:501: Request processed in 186us (318us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789438130.448395:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789438130.448476:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3757800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769662720:0@lo:501: 10000000:01000000:1.0:1789438130.448489:0:7608:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789438130.448512:0:7608:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789438130.448517:0:7608:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c2a54600/0x7a8dd0fcbb924bb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7a8dd0fcbb924bbb expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438130.448532:0:7608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c2a54600/0x7a8dd0fcbb924bb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7a8dd0fcbb924bbb expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438130.448539:0:7608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.109@tcp lock: ffff9991c2a54600/0x7a8dd0fcbb924bb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7a8dd0fcbb924bbb expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438130.448562:0:7608:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789438130.448583:0:7608:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9991ffa93000 10000000:01000000:1.0:1789438130.448588:0:7608:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789438130.448593:0:7608:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789438130.448595:0:7608:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789438130.448599:0:7608:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789438130.448601:0:7608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789438130.448619:0:7608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9da000/0x7a8dd0fcbb924bc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438130.448626:0:7608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991ff9da000/0x7a8dd0fcbb924bc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438130.448634:0:7608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991ff9da000/0x7a8dd0fcbb924bc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438130.448657:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3757800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769662848:0@lo:101: 00000100:00100000:1.0:1789438130.448683:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438130.448695:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e7550840 going to sleep for 11 seconds 00000100:00100000:2.0:1789438130.448840:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769662848 00000100:00100000:2.0:1789438130.448844:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769662848 00000100:00100000:2.0:1789438130.448877:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789438130.448884:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:7608:x1876361769662848:12345-0@lo:101: 00010000:00010000:2.0:1789438130.448893:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438130.448904:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff999202044400/0x7a8dd0fcbb924bc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924bc2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438130.448920:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff999202044400/0x7a8dd0fcbb924bc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924bc2 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438130.448928:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff999202044400/0x7a8dd0fcbb924bc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924bc2 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438130.448934:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999202044400, rc 0) 00000100:00100000:2.0:1789438130.448963:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+13:7608:x1876361769662848:12345-0@lo:101: Request processed in 79us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438130.448969:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789438130.449049:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3757800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769662848:0@lo:101: 00010000:00010000:1.0:1789438130.449060:0:7608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991ff9da000/0x7a8dd0fcbb924bc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924bc9 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438130.449079:0:7608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991ff9da000/0x7a8dd0fcbb924bc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924bc9 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438130.449138:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3757800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769662976:0@lo:501: 00000100:00100000:1.0:1789438130.449175:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438130.449201:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e7550840 going to sleep for 11 seconds 00010000:00010000:3.0:1789438130.449329:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789438130.449336:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991c2a54600/0x7a8dd0fcbb924bb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7a8dd0fcbb924bbb expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438130.449343:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54600 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:3.0:1789438130.449347:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991c2a54600/0x7a8dd0fcbb924bb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7a8dd0fcbb924bbb expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438130.449355:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991c2a54600/0x7a8dd0fcbb924bb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x7a8dd0fcbb924bbb expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789438130.449362:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991c2a54600/0x7a8dd0fcbb924bb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x7a8dd0fcbb924bbb expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789438130.449367:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789438130.449386:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991c2a54600/0x7a8dd0fcbb924bb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7a8dd0fcbb924bbb expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438130.449402:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789438130.449426:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991c2a54600/0x7a8dd0fcbb924bb4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7a8dd0fcbb924bbb expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438130.449434:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991c2a54600/0x7a8dd0fcbb924bb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7a8dd0fcbb924bbb expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438130.449447:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438130.449449:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438130.449450:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438130.449460:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769662976 00000100:00100000:3.0:1789438130.449463:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769662976 00000100:00100000:3.0:1789438130.449484:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789438130.449490:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+13:7608:x1876361769662976:12345-0@lo:501: 00000100:00100000:3.0:1789438130.450095:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+13:7608:x1876361769662976:12345-0@lo:501: Request processed in 603us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438130.450102:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789438130.450175:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769663104:0@lo:103: 00000100:00100000:0.0:1789438130.450210:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438130.450365:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3757800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769662976:0@lo:501: 00000100:00100000:1.0:1789438130.450399:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3757800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769663232:0@lo:503: 00000100:00100000:1.0:1789438130.450438:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438130.450461:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e7550840 going to sleep for 11 seconds 00000100:00100000:3.0:1789438130.450514:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769663104 00000100:00100000:3.0:1789438130.450520:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769663104 00000100:00100000:0.0:1789438130.451438:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769663232 00000100:00100000:0.0:1789438130.451446:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769663232 00000100:00100000:3.0:1789438130.451598:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789438130.451609:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+14:3311:x1876361769663104:12345-0@lo:103: 00010000:00010000:3.0:1789438130.451621:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438130.451636:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff999202045800/0x7a8dd0fcbb924bbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7a8dd0fcbb924bb4 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438130.451664:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789438130.451727:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+13:3311:x1876361769663104:12345-0@lo:103: Request processed in 121us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438130.451744:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789438130.453141:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789438130.453160:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+12:7608:x1876361769663232:12345-0@lo:503: 00000100:00100000:0.0:1789438130.453398:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+12:7608:x1876361769663232:12345-0@lo:503: Request processed in 246us (2958us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438130.453405:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789438130.453526:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3757800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769663232:0@lo:503: 00000040:00080000:3.0:1789438130.453833:0:7608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789438130.453912:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769663360:0@lo:502: 00000100:00100000:3.0:1789438130.453951:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438130.455204:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769663104:0@lo:103: 00000100:00100000:2.0:1789438130.460920:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769663360 00000100:00100000:2.0:1789438130.460935:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769663360 00000100:00100000:3.0:1789438130.460964:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f12f6900 going to sleep for 11 seconds 00000100:00100000:1.0:1789438130.463588:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789438130.465164:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:7608:x1876361769663360:12345-0@lo:502: 00000100:00100000:3.0:1789438130.465439:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:7608:x1876361769663360:12345-0@lo:502: Request processed in 1839us (11487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438130.465449:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789438130.465655:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769663360:0@lo:502: 00000040:00080000:1.0:1789438130.465975:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789438130.466028:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789438130.466061:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789438130.466104:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789438130.466135:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789438130.466162:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789438130.466506:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3755880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769663488:0@lo:502: 00000100:00100000:1.0:1789438130.466563:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438130.466602:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e7550b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789438130.466668:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769663488 00000100:00100000:2.0:1789438130.466675:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769663488 00000100:00100000:2.0:1789438130.466750:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789438130.466760:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+12:7608:x1876361769663488:12345-0@lo:502: 00000100:00100000:2.0:1789438130.466940:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+12:7608:x1876361769663488:12345-0@lo:502: Request processed in 183us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438130.466947:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789438130.467151:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3755880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769663488:0@lo:502: 00000040:00080000:1.0:1789438130.467260:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789438130.467269:0:7608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1789438130.467976:0:7617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789438130.467984:0:7617:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789438130.467991:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789438130.467993:0:7617:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789438130.467998:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789438130.468013:0:7617:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9991eb25cd40) 00000020:00000080:3.0:1789438130.468032:0:7617:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789438130.468038:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789438130.468097:0:7617:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9991ffa93000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789438130.468104:0:7617:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789438130.468110:0:7617:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7a8dd0fcbb924bd7 00010000:00010000:3.0:1789438130.483673:0:7617:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1789438130.484398:0:7617:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1789438130.493652:0:7617:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789438130.493965:0:7617:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1789438130.499011:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789438130.500271:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1789438130.503978:0:7617:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789438130.503990:0:7617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789438130.503996:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789438130.503998:0:7617:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789438130.504002:0:7617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789438130.504006:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789438130.504007:0:7617:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789438130.504010:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789438130.504012:0:7617:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789438130.504064:0:7617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789438130.504068:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789438130.504069:0:7617:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789438130.504072:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789438130.505352:0:7608:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1789438130.505389:0:7608:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789438130.505407:0:7608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9da000/0x7a8dd0fcbb924bc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924bc9 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438130.505420:0:7608:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991ff9da000/0x7a8dd0fcbb924bc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924bc9 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789438130.505429:0:7608:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9991ffa93000 from 1 10000000:01000000:1.0:1789438130.505432:0:7608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789438130.505469:0:7608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9da600/0x7a8dd0fcbb924bde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438130.505478:0:7608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991ff9da600/0x7a8dd0fcbb924bde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438130.505490:0:7608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991ff9da600/0x7a8dd0fcbb924bde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438130.505513:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3755880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769663616:0@lo:101: 00000100:00100000:1.0:1789438130.505579:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438130.505618:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e7550cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438130.506827:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769663616 00000100:00100000:3.0:1789438130.506837:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769663616 00000100:00100000:3.0:1789438130.506887:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789438130.506896:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+12:7608:x1876361769663616:12345-0@lo:101: 00010000:00010000:3.0:1789438130.506910:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438130.506931:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c2a54600/0x7a8dd0fcbb924be5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924bde expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438130.506954:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c2a54600/0x7a8dd0fcbb924be5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924bde expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438130.506964:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c2a54600/0x7a8dd0fcbb924be5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924bde expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438130.506972:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a54600, rc 0) 00000100:00100000:3.0:1789438130.507020:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+13:7608:x1876361769663616:12345-0@lo:101: Request processed in 126us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438130.507026:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789438130.507410:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3755880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769663616:0@lo:101: 00010000:00010000:1.0:1789438130.507428:0:7608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991ff9da600/0x7a8dd0fcbb924bde lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924be5 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438130.507437:0:7608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991ff9da600/0x7a8dd0fcbb924bde lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924be5 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438130.507535:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3755880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769663744:0@lo:501: 00000100:00100000:1.0:1789438130.507574:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438130.507608:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e7550cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789438130.508593:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769663744 00000100:00100000:0.0:1789438130.508603:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769663744 00000100:00100000:0.0:1789438130.508661:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789438130.508669:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+13:7608:x1876361769663744:12345-0@lo:501: 00000100:00100000:0.0:1789438130.508963:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+13:7608:x1876361769663744:12345-0@lo:501: Request processed in 294us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438130.508970:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789438130.509373:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3755880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769663744:0@lo:501: 00000100:00100000:1.0:1789438130.509412:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3755880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769663872:0@lo:503: 00000100:00100000:1.0:1789438130.509454:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438130.509490:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e7550cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789438130.509619:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769663872 00000100:00100000:2.0:1789438130.509625:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769663872 00000100:00100000:2.0:1789438130.509669:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789438130.509677:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+13:7608:x1876361769663872:12345-0@lo:503: 00000100:00100000:2.0:1789438130.510015:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+13:7608:x1876361769663872:12345-0@lo:503: Request processed in 339us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438130.510023:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789438130.510114:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3755880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769663872:0@lo:503: 00000040:00080000:1.0:1789438130.510411:0:7608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789438130.510468:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3755880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769664000:0@lo:502: 00000100:00100000:1.0:1789438130.510505:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438130.510537:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e7550cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789438130.510737:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769664000 00000100:00100000:0.0:1789438130.510743:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769664000 00000100:00100000:0.0:1789438130.510780:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789438130.510788:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+13:7608:x1876361769664000:12345-0@lo:502: 00000100:00100000:0.0:1789438130.510960:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+13:7608:x1876361769664000:12345-0@lo:502: Request processed in 172us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438130.510975:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789438130.511021:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3755880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769664000:0@lo:502: 00000040:00080000:0.0:1789438130.511251:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789438130.511296:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789438130.511319:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769664128:0@lo:502: 00000100:00100000:0.0:1789438130.511371:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438130.511388:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c6cbe300 going to sleep for 11 seconds 00000100:00100000:0.0:1789438130.511400:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769664128 00000100:00100000:0.0:1789438130.511404:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769664128 00000100:00100000:0.0:1789438130.511420:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789438130.511425:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+13:7608:x1876361769664128:12345-0@lo:502: 00000100:00100000:0.0:1789438130.511525:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+13:7608:x1876361769664128:12345-0@lo:502: Request processed in 99us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438130.511532:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789438130.511565:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769664128:0@lo:502: 00000040:00080000:0.0:1789438130.511630:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789438130.511638:0:7608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789438130.511922:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789438130.511930:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789438130.511933:0:7621:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789438130.511940:0:7621:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9991ffa93000 00000020:00000080:0.0:1789438130.511942:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789438130.511961:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789438130.511964:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789438130.511965:0:7621:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789438130.511968:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789438130.511999:0:7608:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789438130.512017:0:7608:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789438130.512038:0:7608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9da600/0x7a8dd0fcbb924bde lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924be5 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.512050:0:7608:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991ff9da600/0x7a8dd0fcbb924bde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924be5 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789438130.512090:0:7608:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789438130.512093:0:7608:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9991ffa93000 10000000:01000000:0.0:1789438130.512096:0:7608:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9991ffa93000 10000000:01000000:0.0:1789438130.512099:0:7608:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789438130.512104:0:7608:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9991ffa93000 from 1 10000000:01000000:0.0:1789438130.512107:0:7608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789438130.512130:0:7608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924bec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.512138:0:7608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924bec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.512148:0:7608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924bec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438130.512163:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769664256:0@lo:101: 00000100:00100000:0.0:1789438130.512193:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438130.512210:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c6cbe780 going to sleep for 11 seconds 00000100:00100000:0.0:1789438130.512231:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769664256 00000100:00100000:0.0:1789438130.512234:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769664256 00000100:00100000:0.0:1789438130.512254:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789438130.512260:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+13:7608:x1876361769664256:12345-0@lo:101: 00010000:00010000:0.0:1789438130.512268:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438130.512279:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c0030e00/0x7a8dd0fcbb924bf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924bec expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.512308:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c0030e00/0x7a8dd0fcbb924bf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924bec expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.512319:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c0030e00/0x7a8dd0fcbb924bf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924bec expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.512328:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c0030e00, rc 0) 00000100:00100000:0.0:1789438130.512360:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+14:7608:x1876361769664256:12345-0@lo:101: Request processed in 100us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438130.512367:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789438130.512401:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769664256:0@lo:101: 00010000:00010000:0.0:1789438130.512413:0:7608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924bec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924bf3 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.512421:0:7608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924bec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924bf3 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438130.512481:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769664384:0@lo:501: 00000100:00100000:0.0:1789438130.512502:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438130.512513:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991de1f93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789438130.512524:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769664384 00000100:00100000:0.0:1789438130.512527:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769664384 00000100:00100000:0.0:1789438130.512542:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789438130.512547:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+14:7608:x1876361769664384:12345-0@lo:501: 00000100:00100000:0.0:1789438130.512739:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+14:7608:x1876361769664384:12345-0@lo:501: Request processed in 191us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438130.512745:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789438130.512797:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769664384:0@lo:501: 00000100:00100000:0.0:1789438130.512820:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769664512:0@lo:503: 00000100:00100000:0.0:1789438130.512855:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438130.512868:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991de1f93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789438130.512879:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769664512 00000100:00100000:0.0:1789438130.512882:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769664512 00000100:00100000:0.0:1789438130.512898:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789438130.512903:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+14:7608:x1876361769664512:12345-0@lo:503: 00000100:00100000:0.0:1789438130.513037:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+14:7608:x1876361769664512:12345-0@lo:503: Request processed in 133us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438130.513043:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789438130.513081:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769664512:0@lo:503: 00000040:00080000:0.0:1789438130.513323:0:7608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789438130.513375:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769664640:0@lo:502: 00000100:00100000:0.0:1789438130.513406:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438130.513420:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991de1f93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789438130.513433:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769664640 00000100:00100000:0.0:1789438130.513437:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769664640 00000100:00100000:0.0:1789438130.513453:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789438130.513459:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+14:7608:x1876361769664640:12345-0@lo:502: 00000100:00100000:0.0:1789438130.522081:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+14:7608:x1876361769664640:12345-0@lo:502: Request processed in 8613us (8666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438130.522095:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789438130.522223:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769664640:0@lo:502: 00000040:00080000:1.0:1789438130.522508:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789438130.522556:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789438130.522583:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789438130.522624:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789438130.522677:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789438130.522785:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789438130.522820:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789438130.522850:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789438130.522895:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789438130.522930:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789438130.522959:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789438130.523000:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789438130.523027:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789438130.523055:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789438130.523093:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789438130.523122:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789438130.523162:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789438130.523212:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789438130.523244:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789438130.523277:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789438130.523334:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789438130.523373:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789438130.523404:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789438130.523443:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789438130.523471:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1789438130.523498:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1789438130.523534:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1789438130.523560:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1789438130.523585:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1789438130.523625:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1789438130.523654:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1789438130.523681:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1789438130.523740:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1789438130.523802:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1789438130.523837:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1789438130.523882:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1789438130.523918:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1789438130.523964:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3757480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769664768:0@lo:502: 00000100:00100000:1.0:1789438130.524030:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438130.524076:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e7550cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438130.524158:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769664768 00000100:00100000:3.0:1789438130.524165:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769664768 00000100:00100000:3.0:1789438130.524213:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789438130.524221:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+14:7608:x1876361769664768:12345-0@lo:502: 00000100:00100000:3.0:1789438130.524413:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+14:7608:x1876361769664768:12345-0@lo:502: Request processed in 192us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438130.524420:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789438130.530111:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3757480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769664768:0@lo:502: 00000040:00080000:1.0:1789438130.530256:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1789438130.530270:0:7608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1789438130.534533:0:7622:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789438130.534549:0:7622:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9991ffba4d40) 00000020:00000080:1.0:1789438130.534570:0:7622:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1789438130.534637:0:7622:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9991ffa93000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789438130.535340:0:7622:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9991ffa93000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789438130.535343:0:7622:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9991ffa93000 3 00010000:00080000:1.0:1789438130.535376:0:7622:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9990c2511800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.109@tcp at head 00010000:00010000:1.0:1789438130.537681:0:7622:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1789438130.538043:0:7622:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789438130.538076:0:7622:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789438130.538086:0:7622:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x7a8dd0fcbb924c01 00000100:00080000:1.0:1789438130.538095:0:7622:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789438130.538105:0:7622:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9990c2511800 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:1.0:1789438130.538139:0:7622:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9991f3757480 x1876361769664896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789438130.538212:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1876361769664896:0@lo:38: 00000100:00100000:3.0:1789438130.538273:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789438130.538338:0:7622:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789438130.538498:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769664896 00000100:00100000:2.0:1789438130.538506:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769664896 00000100:00100000:2.0:1789438130.538544:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789438130.538551:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1876361769664896:12345-0@lo:38: 00010000:00080000:2.0:1789438130.538574:0:5838:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:2.0:1789438130.538614:0:5838:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x7a8dd0fcbb924c08 00000004:00100000:2.0:1789438130.538628:0:5838:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789438130.538656:0:5838:0:(import.c:65:import_set_state_nolock()) ffff9991e0718000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789438130.538873:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789438130.538884:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3754700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876361769665024:0@lo:400: 00000100:00100000:1.0:1789438130.538912:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438130.538922:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769665152:0@lo:400: 00000100:00100000:1.0:1789438130.538939:0:5839:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789438130.538946:0:5839:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789438130.538950:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438130.538968:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789438130.538979:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769665280:0@lo:400: 00000100:00100000:0.0:1789438130.539006:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438130.539085:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769665280 00000100:00100000:0.0:1789438130.539090:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769665280 00000100:00100000:0.0:1789438130.539143:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789438130.539150:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769665280:12345-0@lo:400: 00000100:00100000:0.0:1789438130.539200:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769665280:12345-0@lo:400: Request processed in 51us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438130.539207:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789438130.539225:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789438130.539258:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991f3755880 x1876361769665280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438130.539270:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769665280:0@lo:400: 00000100:00100000:0.0:1789438130.539289:0:5840:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789438130.539294:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769665024 00000100:00100000:0.0:1789438130.539297:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769665024 00000100:00100000:0.0:1789438130.539312:0:5840:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789438130.539315:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769665152 00000100:00100000:0.0:1789438130.539317:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769665152 00000100:00100000:0.0:1789438130.539332:0:5840:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789438130.539339:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789438130.539345:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876361769665024:12345-0@lo:400: 00000100:00100000:0.0:1789438130.539379:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876361769665024:12345-0@lo:400: Request processed in 34us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438130.539385:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789438130.539394:0:5840:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789438130.539399:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789438130.539405:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769665152:12345-0@lo:400: 00000100:00100000:0.0:1789438130.539441:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769665152:12345-0@lo:400: Request processed in 36us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438130.539446:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789438130.539458:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789438130.539471:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991f3755f80 x1876361769665152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438130.539481:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769665152:0@lo:400: 00010000:00080000:0.0:1789438130.539503:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991f3754700 x1876361769665024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438130.539511:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3754700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876361769665024:0@lo:400: 00000100:00100000:2.0:1789438130.541916:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876361769664896:12345-0@lo:38: Request processed in 3358us (3636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438130.541929:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789438130.544301:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991f3757480 x1876361769664896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789438140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438130.544316:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789438130.544326:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1789438130.544334:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789438130.544340:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789438130.544350:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9990c2511800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789438130.544357:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1876361769664896:0@lo:38: 00000040:00080000:1.0:1789438130.544593:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1789438130.544955:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06fbb80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7623:1876361769665408:0@lo:901: 00000100:00100000:3.0:1789438130.545015:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438130.545089:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f12f6780 going to sleep for 11 seconds 00000100:00100000:1.0:1789438130.545136:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769665408 00000100:00100000:1.0:1789438130.545142:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769665408 00000100:00100000:1.0:1789438130.545236:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789438130.545246:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7623:x1876361769665408:12345-0@lo:901: 00000020:01000000:0.0:1789438130.545272:0:7608:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1789438130.545297:0:7608:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789438130.545309:0:7608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924bec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924bf3 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.545321:0:7608:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924bec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924bf3 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789438130.545365:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789438130.545367:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789438130.545369:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789438130.545370:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789438130.545371:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789438130.545373:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789438130.545374:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789438130.545376:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789438130.545377:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789438130.545379:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789438130.545380:0:7608:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789438130.545383:0:7608:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1789438130.545389:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789438130.545390:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789438130.545391:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789438130.545392:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789438130.545393:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789438130.545394:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789438130.545395:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789438130.545396:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789438130.545397:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789438130.545397:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789438130.545398:0:7608:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789438130.545412:0:7608:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789438130.545420:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769665536:0@lo:253: 00000100:00100000:0.0:1789438130.545455:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438130.545479:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d59e6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789438130.545552:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769665536 00000100:00100000:0.0:1789438130.545556:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769665536 00000100:00100000:0.0:1789438130.545581:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789438130.545587:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+14:7608:x1876361769665536:12345-0@lo:253: 20000000:01000000:0.0:1789438130.545607:0:5832:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789438130.545619:0:5832:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:1.0:1789438130.545964:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789438130.546046:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7623:x1876361769665408:12345-0@lo:901: Request processed in 801us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438130.546055:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789438130.546303:0:7623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991e06fbb80 x1876361769665408/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789438146 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789438130.546329:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06fbb80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7623:1876361769665408:0@lo:901: 20000000:01000000:1.0:1789438130.583525:0:5832:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789438130.583546:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789438130.584082:0:5854:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789438130.584088:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789438130.584122:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff999202045c00/0x7a8dd0fcbb924c0f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438130.584142:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991e0966e00/0x7a8dd0fcbb924b60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924b59 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438130.584150:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff999202045c00/0x7a8dd0fcbb924c0f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438130.584191:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991e0966e00/0x7a8dd0fcbb924b60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb924b59 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438130.584206:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9991e0966e00/0x7a8dd0fcbb924b60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b59 expref: 14 pid: 5832 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438130.584222:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f419ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1876361769665664:0@lo:104: 00000100:00100000:2.0:1789438130.584286:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438130.584342:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff9990c13859c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789438130.584386:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769665664 00000100:00100000:0.0:1789438130.584395:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769665664 00000100:00100000:0.0:1789438130.584447:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789438130.584458:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f419a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+3:5854:x1876361769665664:12345-0@lo:104: 00010000:00010000:0.0:1789438130.584472:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9991c0030600/0x7a8dd0fcbb924b59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924b60 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.584540:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789438130.584546:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f419a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+3:5854:x1876361769665664:12345-0@lo:104: Request processed in 91us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438130.584554:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1789438130.584597:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789438130.584603:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991c0030600/0x7a8dd0fcbb924b59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924b60 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.584611:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c0030600 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:0.0:1789438130.584615:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991c0030600/0x7a8dd0fcbb924b59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb924b60 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.584622:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991c0030600/0x7a8dd0fcbb924b59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb924b60 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789438130.584628:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991c0030600/0x7a8dd0fcbb924b59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb924b60 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789438130.584634:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789438130.584660:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991c0030600/0x7a8dd0fcbb924b59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924b60 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.584666:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789438130.584682:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991c0030600/0x7a8dd0fcbb924b59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924b60 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.584690:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991c0030600/0x7a8dd0fcbb924b59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924b60 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.584730:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438130.584732:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438130.584734:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438130.584753:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769665792:0@lo:103: 00000100:00100000:0.0:1789438130.584800:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438130.584838:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769665792 00000100:00100000:0.0:1789438130.584847:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769665792 00010000:00010000:0.0:1789438130.584864:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991e0966e00/0x7a8dd0fcbb924b60 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b59 expref: 15 pid: 5832 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438130.584887:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789438130.584894:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d0512050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+15:3311:x1876361769665792:12345-0@lo:103: 00010000:00010000:0.0:1789438130.584903:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438130.584908:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991e0966e00/0x7a8dd0fcbb924b60 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b59 expref: 15 pid: 5832 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.584918:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991e0966e00/0x7a8dd0fcbb924b60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b59 expref: 15 pid: 5832 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.584939:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff999202045c00/0x7a8dd0fcbb924c0f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.584948:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff999202045c00/0x7a8dd0fcbb924c0f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789438130.584959:0:5823:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002447297s 00010000:00010000:0.0:1789438130.584963:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff999202045c00/0x7a8dd0fcbb924c0f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.584970:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff999202045c00/0x7a8dd0fcbb924c0f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.584978:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff999202045c00/0x7a8dd0fcbb924c0f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.584986:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff999202045c00/0x7a8dd0fcbb924c0f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.585000:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999202045c00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:0.0:1789438130.585004:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff999202045c00/0x7a8dd0fcbb924c0f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.585011:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff999202045c00/0x7a8dd0fcbb924c0f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.585019:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff999202045c00/0x7a8dd0fcbb924c0f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438130.585045:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438130.585074:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d0512050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+15:3311:x1876361769665792:12345-0@lo:103: Request processed in 180us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438130.585081:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789438130.585135:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769665792:0@lo:103: 00010000:00010000:2.0:1789438130.585312:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991e0966e00/0x7a8dd0fcbb924b60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b59 expref: 14 pid: 5832 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438130.585327:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f419ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1876361769665664:0@lo:104: 00010000:00010000:2.0:1789438130.585346:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff999202045c00/0x7a8dd0fcbb924c0f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438130.585356:0:5854:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff999202045c00/0x7a8dd0fcbb924c0f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438130.585362:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff999202045c00/0x7a8dd0fcbb924c0f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438130.585443:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff999202045c00/0x7a8dd0fcbb924c0f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438130.595385:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+13:7608:x1876361769665536:12345-0@lo:253: Request processed in 49788us (49919us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438130.595401:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789438130.595518:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7073a0da-08cf-42fe-8791-a8c6139408f2:7608:1876361769665536:0@lo:253: 10000000:01000000:0.0:1789438130.595534:0:7608:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789438130.595538:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789438130.595539:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789438130.595541:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789438130.595542:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789438130.595543:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789438130.595544:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789438130.595546:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789438130.595548:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789438130.595549:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789438130.595551:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789438130.595552:0:7608:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789438130.595568:0:7608:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789438130.601590:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789438130.603660:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789438130.604149:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789438130.604338:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789438130.604543:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789438130.604797:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789438130.605873:0:7608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789438130.804066:0:7608:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789438130.804075:0:7608:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789438130.804116:0:7608:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789438130.804180:0:7608:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.109@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789438130.804198:0:7608:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789438130.804220:0:7608:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:2.0:1789438131.000462:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f419ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769665920:0@lo:13: 00000100:00100000:2.0:1789438131.000525:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438131.000645:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769665920 00000100:00100000:2.0:1789438131.000652:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769665920 00000100:00100000:2.0:1789438131.000696:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789438131.000780:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4198e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769665920:12345-0@lo:13: 00002000:00000024:2.0:1789438131.000816:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789438131.000869:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4198e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769665920:12345-0@lo:13: Request processed in 165us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438131.000878:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789438131.000948:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991f419ad80 x1876361769665920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438146 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438131.000967:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f419ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769665920:0@lo:13: 00010000:00010000:3.0:1789438131.064557:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438132.086964:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438133.110932:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438134.140829:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438135.159010:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438135.609928:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769666048:0@lo:400: 00000100:00100000:0.0:1789438135.610005:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438135.610269:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876361769666560:0@lo:400: 00000100:00100000:0.0:1789438135.610299:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438135.610323:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789438135.610329:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769666176:0@lo:400: 00000100:00100000:0.0:1789438135.610348:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438135.610377:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769666304:0@lo:400: 00000100:00100000:0.0:1789438135.610398:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438135.610415:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789438135.610421:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769666432:0@lo:400: 00000100:00100000:0.0:1789438135.610443:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438135.610472:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769666560 00000100:00100000:0.0:1789438135.610480:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769666560 00000100:00100000:0.0:1789438135.610526:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769666176 00000100:00100000:0.0:1789438135.610529:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769666176 00000100:00100000:0.0:1789438135.610543:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769666304 00000100:00100000:0.0:1789438135.610545:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769666304 00000100:00100000:0.0:1789438135.610560:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789438135.610567:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876361769666560:12345-0@lo:400: 00000100:00100000:0.0:1789438135.610615:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876361769666560:12345-0@lo:400: Request processed in 48us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438135.610622:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789438135.610640:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789438135.610645:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769666176:12345-0@lo:400: 00000100:00100000:0.0:1789438135.610670:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769666176:12345-0@lo:400: Request processed in 25us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438135.610675:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789438135.610696:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789438135.610734:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769666304:12345-0@lo:400: 00000100:00100000:0.0:1789438135.610775:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769666304:12345-0@lo:400: Request processed in 74us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438135.610781:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1789438135.610801:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789438135.610825:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991c7e8c700 x1876361769666304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438135.610838:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769666304:0@lo:400: 00010000:00080000:0.0:1789438135.610864:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991c7e8fb80 x1876361769666176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438135.610872:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769666176:0@lo:400: 00010000:00080000:0.0:1789438135.610881:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991c7e8f480 x1876361769666560/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438135.610888:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876361769666560:0@lo:400: 00000100:00100000:1.0:1789438135.618434:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769666048 00000100:00100000:1.0:1789438135.618447:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769666048 00000100:00100000:1.0:1789438135.618500:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789438135.618510:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+13:3309:x1876361769666048:12345-0@lo:400: 00000100:00100000:1.0:1789438135.618622:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+13:3309:x1876361769666048:12345-0@lo:400: Request processed in 114us (8616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438135.618629:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789438135.618690:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769666048:0@lo:400: 00000100:00100000:3.0:1789438135.621925:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769666432 00000100:00100000:3.0:1789438135.621941:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769666432 00000100:00100000:3.0:1789438135.622004:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789438135.622028:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769666432:12345-0@lo:400: 00000100:00100000:3.0:1789438135.622120:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769666432:12345-0@lo:400: Request processed in 108us (11675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438135.622127:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789438135.622161:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789438135.622196:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991c7e8e680 x1876361769666432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438135.622211:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769666432:0@lo:400: 00000100:00100000:2.0:1789438136.121118:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f419ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769666688:0@lo:13: 00000100:00100000:2.0:1789438136.121185:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438136.121251:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769666688 00000100:00100000:2.0:1789438136.121258:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769666688 00000100:00100000:2.0:1789438136.121295:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789438136.121304:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769666688:12345-0@lo:13: 00002000:00000024:2.0:1789438136.121337:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789438136.121384:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769666688:12345-0@lo:13: Request processed in 79us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438136.121392:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789438136.121428:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991f419ad80 x1876361769666688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438136.121445:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f419ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769666688:0@lo:13: 00010000:00010000:2.0:1789438136.187586:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789438137.038041:0:7968:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg609-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789438137.206902:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438138.232606:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438139.255665:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438140.281072:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438140.727175:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789438140.727202:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769666816:0@lo:400: 00000100:00100000:0.0:1789438140.727275:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438140.727346:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876361769666944:0@lo:400: 00000100:00100000:0.0:1789438140.727371:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438140.727399:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769666944 00000100:00100000:0.0:1789438140.727405:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769666944 00000100:00100000:0.0:1789438140.727443:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789438140.727450:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876361769666944:12345-0@lo:400: 00000100:00100000:0.0:1789438140.727503:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876361769666944:12345-0@lo:400: Request processed in 53us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438140.727511:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789438140.727547:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991c7e8fb80 x1876361769666944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438140.727561:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876361769666944:0@lo:400: 00000100:00100000:0.0:1789438140.727595:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769667072:0@lo:400: 00000100:00100000:0.0:1789438140.727616:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438140.727640:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769667072 00000100:00100000:2.0:1789438140.727765:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769666816 00000100:00100000:2.0:1789438140.727769:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769666816 00000100:00100000:2.0:1789438140.727794:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789438140.727812:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+13:3312:x1876361769666816:12345-0@lo:400: 00000100:00100000:2.0:1789438140.727860:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+13:3312:x1876361769666816:12345-0@lo:400: Request processed in 59us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438140.727866:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789438140.727903:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769666816:0@lo:400: 10000000:01000000:1.0:1789438140.728166:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789438140.728170:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9991d08f6800 from 30 10000000:01000000:1.0:1789438140.728173:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789438140.728203:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9dbe00/0x7a8dd0fcbb924c16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438140.728214:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991ff9dbe00/0x7a8dd0fcbb924c16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438140.728224:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991ff9dbe00/0x7a8dd0fcbb924c16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438140.728239:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3754e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769667200:0@lo:101: 00000100:00100000:1.0:1789438140.728266:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438140.728297:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d04f39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789438140.728336:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769667200 00000100:00100000:2.0:1789438140.728346:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769667200 00000100:00100000:2.0:1789438140.728374:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789438140.728380:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+13:5836:x1876361769667200:12345-0@lo:101: 00010000:00010000:2.0:1789438140.728388:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438140.728399:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff999202045c00/0x7a8dd0fcbb924c1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924c16 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438140.728418:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff999202045c00/0x7a8dd0fcbb924c1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924c16 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438140.728428:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff999202045c00/0x7a8dd0fcbb924c1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924c16 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438140.728436:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999202045c00, rc 0) 00000100:00100000:2.0:1789438140.728462:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+14:5836:x1876361769667200:12345-0@lo:101: Request processed in 83us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438140.728468:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789438140.728492:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3754e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769667200:0@lo:101: 00010000:00010000:2.0:1789438140.728503:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991ff9dbe00/0x7a8dd0fcbb924c16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924c1d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438140.728512:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991ff9dbe00/0x7a8dd0fcbb924c16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924c1d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438140.728552:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f419ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769667328:0@lo:501: 00000100:00100000:2.0:1789438140.728572:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438140.728582:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c8128900 going to sleep for 11 seconds 00000100:00100000:2.0:1789438140.728591:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769667328 00000100:00100000:2.0:1789438140.728594:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769667328 00000100:00100000:2.0:1789438140.728616:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789438140.728621:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+14:5836:x1876361769667328:12345-0@lo:501: 00000100:00100000:0.0:1789438140.729073:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769667072 00000100:00100000:0.0:1789438140.730014:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789438140.730025:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769667072:12345-0@lo:400: 00000100:00100000:0.0:1789438140.730084:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769667072:12345-0@lo:400: Request processed in 62us (2466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438140.730090:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789438140.730127:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991c7e8fb80 x1876361769667072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438140.730139:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769667072:0@lo:400: 00000100:00100000:0.0:1789438140.730181:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769667456:0@lo:400: 00000100:00100000:0.0:1789438140.730209:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438140.730323:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769667456 00000100:00100000:0.0:1789438140.730328:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769667456 00000100:00100000:2.0:1789438140.730566:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+14:5836:x1876361769667328:12345-0@lo:501: Request processed in 1943us (1992us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438140.730573:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789438140.730620:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f419ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769667328:0@lo:501: 00000100:00100000:2.0:1789438140.730648:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f419ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769667584:0@lo:503: 00000100:00100000:2.0:1789438140.730702:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438140.730756:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c8128900 going to sleep for 11 seconds 00000100:00100000:2.0:1789438140.730768:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769667584 00000100:00100000:2.0:1789438140.730771:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769667584 00000100:00100000:2.0:1789438140.730798:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789438140.730805:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+14:5836:x1876361769667584:12345-0@lo:503: 00000100:00100000:2.0:1789438140.730943:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+14:5836:x1876361769667584:12345-0@lo:503: Request processed in 138us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438140.730950:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789438140.731050:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f419ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769667584:0@lo:503: 00000100:00100000:2.0:1789438140.731210:0:8096:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f419ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8096:1876361769667712:0@lo:502: 00000100:00100000:2.0:1789438140.731242:0:8096:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438140.731259:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769667712 00000100:00100000:2.0:1789438140.731262:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769667712 00000100:00100000:2.0:1789438140.731284:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789438140.731290:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+14:8096:x1876361769667712:12345-0@lo:502: 00000100:00100000:3.0:1789438140.732336:0:8096:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c8128000 going to sleep for 11 seconds 00000100:00100000:2.0:1789438140.733087:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f419b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769667840:0@lo:400: 00000100:00100000:2.0:1789438140.733146:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438140.733214:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769667840 00000100:00100000:2.0:1789438140.733221:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769667840 00000100:00100000:3.0:1789438140.733311:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+14:8096:x1876361769667712:12345-0@lo:502: Request processed in 2019us (2066us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438140.733326:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789438140.733386:0:8096:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f419ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8096:1876361769667712:0@lo:502: 00000100:00100000:3.0:1789438140.733436:0:8096:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06f8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8096:1876361769667968:0@lo:502: 00000100:00100000:3.0:1789438140.733469:0:8096:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438140.733491:0:8096:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fa9eacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438140.733522:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769667968 00000100:00100000:3.0:1789438140.733525:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769667968 00000100:00100000:3.0:1789438140.733554:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789438140.733561:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+14:8096:x1876361769667968:12345-0@lo:502: 00000100:00100000:3.0:1789438140.733810:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+14:8096:x1876361769667968:12345-0@lo:502: Request processed in 248us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438140.733817:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789438140.734213:0:8096:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06f8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8096:1876361769667968:0@lo:502: 00000040:00080000:3.0:1789438140.734235:0:8096:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789438140.734493:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789438140.734509:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789438140.734517:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9dbe00/0x7a8dd0fcbb924c16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924c1d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438140.734528:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991ff9dbe00/0x7a8dd0fcbb924c16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924c1d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789438140.734537:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789438140.734540:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1789438140.734542:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789438140.734569:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c2a55800/0x7a8dd0fcbb924c24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438140.734584:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991c2a55800/0x7a8dd0fcbb924c24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438140.734595:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991c2a55800/0x7a8dd0fcbb924c24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438140.734611:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769668096:0@lo:101: 00000100:00100000:3.0:1789438140.734653:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438140.734671:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fa9eacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438140.734685:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769668096 00000100:00100000:3.0:1789438140.734689:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769668096 00000100:00100000:3.0:1789438140.734748:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789438140.734755:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+14:5836:x1876361769668096:12345-0@lo:101: 00010000:00010000:3.0:1789438140.734765:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438140.734777:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb924c2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924c24 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438140.734797:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb924c2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924c24 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438140.734819:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb924c2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924c24 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438140.734827:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a54400, rc 0) 00000100:00100000:3.0:1789438140.734869:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+15:5836:x1876361769668096:12345-0@lo:101: Request processed in 115us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438140.734876:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789438140.734907:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769668096:0@lo:101: 00010000:00010000:3.0:1789438140.734924:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991c2a55800/0x7a8dd0fcbb924c24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924c2b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438140.734933:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991c2a55800/0x7a8dd0fcbb924c24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924c2b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438140.734973:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769668224:0@lo:501: 00000100:00100000:3.0:1789438140.737221:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438140.737245:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fa9eacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438140.737272:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769668224 00000100:00100000:3.0:1789438140.737279:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769668224 00000100:00100000:3.0:1789438140.737313:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789438140.737320:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+15:5836:x1876361769668224:12345-0@lo:501: 00000100:00100000:3.0:1789438140.737541:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+15:5836:x1876361769668224:12345-0@lo:501: Request processed in 220us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438140.737549:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789438140.737586:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769668224:0@lo:501: 00000100:00100000:3.0:1789438140.737623:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769668352:0@lo:503: 00000100:00100000:3.0:1789438140.737679:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438140.737693:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fa9eacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438140.737705:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769668352 00000100:00100000:3.0:1789438140.737736:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769668352 00000100:00100000:3.0:1789438140.737756:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789438140.737762:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+15:5836:x1876361769668352:12345-0@lo:503: 00000100:00100000:3.0:1789438140.737962:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+15:5836:x1876361769668352:12345-0@lo:503: Request processed in 199us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438140.737969:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789438140.738013:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769668352:0@lo:503: 00000100:00100000:3.0:1789438140.738195:0:8097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06f8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8097:1876361769668480:0@lo:502: 00000100:00100000:3.0:1789438140.738236:0:8097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438140.738254:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769668480 00000100:00100000:3.0:1789438140.738258:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769668480 00000100:00100000:3.0:1789438140.738279:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789438140.738285:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+15:8097:x1876361769668480:12345-0@lo:502: 00000100:00100000:3.0:1789438140.738420:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+15:8097:x1876361769668480:12345-0@lo:502: Request processed in 135us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438140.738427:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789438140.738456:0:8097:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991de1f9780 going to sleep for 11 seconds 00000100:00100000:3.0:1789438140.738467:0:8097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06f8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8097:1876361769668480:0@lo:502: 00000100:00080000:1.0:1789438140.740012:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789438140.740157:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:3.0:1789438140.740632:0:8097:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789438140.740656:0:8097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789438140.740659:0:8097:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789438140.740668:0:8097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789438140.740670:0:8097:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789438140.740740:0:8097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06f8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8097:1876361769668608:0@lo:502: 00000100:00100000:3.0:1789438140.740820:0:8097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438140.741049:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769668608 00000100:00100000:1.0:1789438140.741056:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769668608 00000100:00100000:1.0:1789438140.741099:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789438140.741108:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+15:8097:x1876361769668608:12345-0@lo:502: 00000100:00100000:0.0:1789438140.741459:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789438140.741468:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769667456:12345-0@lo:400: 00000100:00100000:1.0:1789438140.745104:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+15:8097:x1876361769668608:12345-0@lo:502: Request processed in 3986us (4272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438140.745119:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789438140.745427:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789438140.745439:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769667840:12345-0@lo:400: 00000100:00100000:2.0:1789438140.745500:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769667840:12345-0@lo:400: Request processed in 65us (12354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438140.745507:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789438140.745552:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991f419b480 x1876361769667840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438140.745568:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f419b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769667840:0@lo:400: 00000100:00100000:3.0:1789438140.745686:0:8097:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991de1f9780 going to sleep for 11 seconds 00000100:00100000:3.0:1789438140.745700:0:8097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06f8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8097:1876361769668608:0@lo:502: 00000020:01000000:3.0:1789438140.745753:0:8097:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789438140.745760:0:8097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789438140.745762:0:8097:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789438140.745766:0:8097:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1789438140.746170:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1789438140.746188:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789438140.746197:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c2a55800/0x7a8dd0fcbb924c24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924c2b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438140.746209:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991c2a55800/0x7a8dd0fcbb924c24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924c2b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789438140.746219:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789438140.746221:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9991d197a000 from 30 10000000:01000000:2.0:1789438140.746224:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789438140.746251:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924c32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438140.746259:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924c32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438140.746268:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924c32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438140.746297:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f419b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769668736:0@lo:101: 00000100:00100000:2.0:1789438140.746330:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438140.746356:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c8128f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789438140.752040:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769668736 00000100:00100000:3.0:1789438140.752055:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769668736 00000100:00100000:3.0:1789438140.752109:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789438140.752134:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+15:5836:x1876361769668736:12345-0@lo:101: 00010000:00010000:3.0:1789438140.752152:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438140.752170:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c2a54a00/0x7a8dd0fcbb924c39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924c32 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438140.752197:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c2a54a00/0x7a8dd0fcbb924c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924c32 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438140.752209:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c2a54a00/0x7a8dd0fcbb924c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924c32 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438140.752218:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a54a00, rc 0) 00000100:00100000:3.0:1789438140.752282:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+16:5836:x1876361769668736:12345-0@lo:101: Request processed in 151us (5951us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438140.752289:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789438140.752337:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f419b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769668736:0@lo:101: 00010000:00010000:3.0:1789438140.752352:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924c32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924c39 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438140.752362:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924c32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924c39 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438140.752417:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769668864:0@lo:501: 00000100:00100000:3.0:1789438140.752442:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438140.752468:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991de1f9900 going to sleep for 11 seconds 00000100:00100000:3.0:1789438140.752479:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769668864 00000100:00100000:3.0:1789438140.752482:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769668864 00000100:00100000:3.0:1789438140.752499:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789438140.752504:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+16:5836:x1876361769668864:12345-0@lo:501: 00000100:00100000:3.0:1789438140.754092:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+16:5836:x1876361769668864:12345-0@lo:501: Request processed in 1580us (1641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438140.754104:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789438140.754168:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769668864:0@lo:501: 00000100:00100000:3.0:1789438140.754213:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769668992:0@lo:503: 00000100:00100000:3.0:1789438140.754255:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438140.754271:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991de1f9900 going to sleep for 11 seconds 00000100:00100000:3.0:1789438140.754284:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769668992 00000100:00100000:3.0:1789438140.754289:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769668992 00000100:00100000:3.0:1789438140.754313:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789438140.754320:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+16:5836:x1876361769668992:12345-0@lo:503: 00000100:00100000:3.0:1789438140.754455:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+16:5836:x1876361769668992:12345-0@lo:503: Request processed in 135us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438140.754462:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789438140.754494:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769668992:0@lo:503: 00000100:00100000:3.0:1789438140.756242:0:8099:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06f8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8099:1876361769669120:0@lo:502: 00000100:00100000:3.0:1789438140.756300:0:8099:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438140.756333:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769669120 00000100:00100000:3.0:1789438140.756339:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769669120 00000100:00100000:3.0:1789438140.756376:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789438140.756385:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+16:8099:x1876361769669120:12345-0@lo:502: 00000100:00100000:3.0:1789438140.756598:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+16:8099:x1876361769669120:12345-0@lo:502: Request processed in 214us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438140.756606:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789438140.756654:0:8099:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991de1f9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789438140.756680:0:8099:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06f8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8099:1876361769669120:0@lo:502: 00000100:00100000:3.0:1789438140.756751:0:8099:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06f8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8099:1876361769669248:0@lo:502: 00000100:00100000:3.0:1789438140.756782:0:8099:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438140.756798:0:8099:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991de1f9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789438140.757129:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769667456:12345-0@lo:400: Request processed in 15661us (26916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438140.757145:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789438140.757785:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769669248 00000100:00100000:0.0:1789438140.757793:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769669248 00000100:00100000:0.0:1789438140.757849:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789438140.757858:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+16:8099:x1876361769669248:12345-0@lo:502: 00010000:00080000:1.0:1789438140.758072:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991c7e8fb80 x1876361769667456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438140.758077:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+16:8099:x1876361769669248:12345-0@lo:502: Request processed in 218us (1292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438140.758092:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789438140.758099:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769667456:0@lo:400: 00000100:00100000:3.0:1789438140.760254:0:8099:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06f8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8099:1876361769669248:0@lo:502: 00000040:00080000:3.0:1789438140.760294:0:8099:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789438140.760761:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789438140.760779:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789438140.760789:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924c32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924c39 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438140.760800:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924c32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924c39 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789438140.760820:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789438140.760822:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9991d197a000 from 5 10000000:01000000:0.0:1789438140.760825:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789438140.760987:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c0030c00/0x7a8dd0fcbb924c40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438140.760997:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991c0030c00/0x7a8dd0fcbb924c40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438140.761007:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991c0030c00/0x7a8dd0fcbb924c40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438140.761027:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769669376:0@lo:101: 00000100:00100000:0.0:1789438140.761091:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438140.761126:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9990c1385180 going to sleep for 11 seconds 00000100:00100000:3.0:1789438140.762997:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769669376 00000100:00100000:3.0:1789438140.763009:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769669376 00000100:00100000:3.0:1789438140.763057:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789438140.763066:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+16:5836:x1876361769669376:12345-0@lo:101: 00010000:00010000:3.0:1789438140.763082:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438140.763099:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c2a54000/0x7a8dd0fcbb924c47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924c40 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438140.763125:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c2a54000/0x7a8dd0fcbb924c47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924c40 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438140.763137:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c2a54000/0x7a8dd0fcbb924c47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924c40 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438140.763146:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a54000, rc 0) 00000100:00100000:3.0:1789438140.764264:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+17:5836:x1876361769669376:12345-0@lo:101: Request processed in 1192us (3166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438140.764274:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789438140.764377:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769669376:0@lo:101: 00010000:00010000:0.0:1789438140.764397:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991c0030c00/0x7a8dd0fcbb924c40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924c47 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438140.764409:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991c0030c00/0x7a8dd0fcbb924c40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924c47 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438140.764469:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769669504:0@lo:256: 00000100:00100000:0.0:1789438140.764502:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438140.764535:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9990c1385180 going to sleep for 11 seconds 00000100:00100000:3.0:1789438140.764580:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769669504 00000100:00100000:3.0:1789438140.764586:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769669504 00000100:00100000:3.0:1789438140.764618:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789438140.764626:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+17:5836:x1876361769669504:12345-0@lo:256: 20000000:01000000:3.0:1789438140.764704:0:5831:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789438140.764747:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789438140.764749:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789438140.764991:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+17:5836:x1876361769669504:12345-0@lo:256: Request processed in 366us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438140.764998:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789438140.765275:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769669504:0@lo:256: 10000000:01000000:1.0:1789438140.765319:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789438140.765327:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c0030c00/0x7a8dd0fcbb924c40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924c47 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438140.765336:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991c0030c00/0x7a8dd0fcbb924c40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924c47 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789438140.765345:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789438140.765348:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1789438140.765350:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789438140.765372:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9db600/0x7a8dd0fcbb924c4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438140.765379:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991ff9db600/0x7a8dd0fcbb924c4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438140.765389:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991ff9db600/0x7a8dd0fcbb924c4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438140.765407:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3757100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769669632:0@lo:101: 00000100:00100000:1.0:1789438140.765439:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438140.765469:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d04f3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789438140.765741:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769669632 00000100:00100000:3.0:1789438140.765746:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769669632 00000100:00100000:3.0:1789438140.765779:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789438140.765785:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+17:5836:x1876361769669632:12345-0@lo:101: 00010000:00010000:3.0:1789438140.765794:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438140.766152:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c2a54200/0x7a8dd0fcbb924c55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924c4e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438140.766174:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c2a54200/0x7a8dd0fcbb924c55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924c4e expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438140.766184:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c2a54200/0x7a8dd0fcbb924c55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924c4e expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438140.766192:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a54200, rc 0) 00000100:00100000:3.0:1789438140.766273:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769669632:12345-0@lo:101: Request processed in 487us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438140.766280:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789438140.773515:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3757100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769669632:0@lo:101: 00010000:00010000:0.0:1789438140.773542:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991ff9db600/0x7a8dd0fcbb924c4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924c55 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438140.773555:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991ff9db600/0x7a8dd0fcbb924c4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924c55 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438140.773629:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769669760:0@lo:501: 00000100:00100000:0.0:1789438140.774175:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438140.774226:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9990c1385240 going to sleep for 11 seconds 00000100:00100000:3.0:1789438140.774312:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769669760 00000100:00100000:3.0:1789438140.774319:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769669760 00000100:00100000:3.0:1789438140.774366:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789438140.774376:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769669760:12345-0@lo:501: 00000100:00100000:3.0:1789438140.774631:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769669760:12345-0@lo:501: Request processed in 256us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438140.774656:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789438140.774763:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769669760:0@lo:501: 00000100:00100000:2.0:1789438140.774825:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f419a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769669888:0@lo:503: 00000100:00100000:2.0:1789438140.775025:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438140.775048:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c8128780 going to sleep for 11 seconds 00000100:00100000:3.0:1789438140.775378:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769669888 00000100:00100000:3.0:1789438140.775384:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769669888 00000100:00100000:3.0:1789438140.775418:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789438140.775426:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769669888:12345-0@lo:503: 00000100:00100000:3.0:1789438140.775629:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769669888:12345-0@lo:503: Request processed in 203us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438140.775636:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789438140.775691:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f419a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769669888:0@lo:503: 00000100:00100000:2.0:1789438140.782066:0:8100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f4198a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8100:1876361769670016:0@lo:502: 00000100:00100000:2.0:1789438140.782157:0:8100:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438140.782197:0:8100:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c81283c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438140.782324:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769670016 00000100:00100000:3.0:1789438140.782332:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769670016 00000100:00100000:3.0:1789438140.782378:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789438140.782387:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+18:8100:x1876361769670016:12345-0@lo:502: 00000100:00100000:3.0:1789438140.783180:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+18:8100:x1876361769670016:12345-0@lo:502: Request processed in 790us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438140.783190:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789438140.783468:0:8100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f4198a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8100:1876361769670016:0@lo:502: 00000020:01000000:0.0:1789438140.783501:0:8100:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789438140.783509:0:8100:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789438140.783516:0:8100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789438140.783518:0:8100:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789438140.783531:0:8100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789438140.783535:0:8100:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.109@tcp to nid 0x20000c0a8ce6d (192.168.206.109@tcp) 00000020:01000000:0.0:1789438140.783555:0:8100:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789438140.783558:0:8100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789438140.783580:0:8100:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9991fa9b0000) 00000020:00000080:0.0:1789438140.783601:0:8100:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1789438140.783609:0:8100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789438140.783697:0:8100:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789438140.783703:0:8100:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789438140.783747:0:8100:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7a8dd0fcbb924c63 00010000:00080000:0.0:1789438140.783773:0:8100:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9990c1268000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.109@tcp at head 00010000:00010000:0.0:1789438140.787432:0:8100:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1789438140.794683:0:8100:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789438140.794701:0:8100:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789438140.795247:0:8100:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789438140.795417:0:8100:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789438140.795460:0:8100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1789438140.795507:0:8100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789438140.801448:0:8101:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789438140.801455:0:8101:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789438140.802425:0:8100:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789438140.802437:0:8100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789438140.802469:0:8100:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789438140.802489:0:8100:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7a8dd0fcbb924c6a 00000100:00080000:2.0:1789438140.802499:0:8100:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789438140.802512:0:8100:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9990c1268000 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:2.0:1789438140.802551:0:8100:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9991f4198a80 x1876361769670144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789438140.802595:0:8100:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789438140.802666:0:8100:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789438140.802671:0:8100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789438140.802673:0:8100:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789438140.802676:0:8100:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789438140.802680:0:8100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789438140.802682:0:8100:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789438140.802685:0:8100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789438140.802687:0:8100:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789438140.802754:0:8100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f419a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8100:1876361769670272:0@lo:502: 00000100:00100000:2.0:1789438140.802834:0:8100:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438140.802990:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f4198a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876361769670144:0@lo:8: 00000100:00100000:3.0:1789438140.803026:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438140.803082:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769670144 00000100:00100000:3.0:1789438140.803100:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769670144 00000100:00100000:3.0:1789438140.803138:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789438140.803144:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1876361769670144:12345-0@lo:8: 00010000:00080000:3.0:1789438140.803167:0:6680:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:3.0:1789438140.803191:0:6680:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7a8dd0fcbb924c71 00002000:00100000:3.0:1789438140.803203:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9991f440e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789438140.803214:0:6680:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1789438140.803218:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1789438140.803323:0:6680:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789438140.803466:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789438140.803488:0:6680:0:(import.c:65:import_set_state_nolock()) ffff9991f440f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789438140.803530:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1876361769670144:12345-0@lo:8: Request processed in 385us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438140.803536:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789438140.803574:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991f4198a80 x1876361769670144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789438150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438140.803584:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789438140.803591:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789438140.803598:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789438140.803603:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789438140.803605:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9990c1268000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789438140.803616:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789438140.803621:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f4198a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876361769670144:0@lo:8: 00000100:00100000:2.0:1789438140.803959:0:8100:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c8128cc0 going to sleep for 11 seconds 00000004:00080000:2.0:1789438140.803973:0:8101:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789438140.804070:0:8101:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 193069361254ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789438140.804455:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769670784:0@lo:400: 00000100:00100000:1.0:1789438140.804492:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438140.804515:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789438140.804521:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876361769670400:0@lo:400: 00000100:00100000:1.0:1789438140.804542:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438140.804566:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769670528:0@lo:400: 00000100:00100000:1.0:1789438140.804588:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438140.804606:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789438140.804611:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769670656:0@lo:400: 00000100:00100000:1.0:1789438140.804635:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438140.804764:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769670784 00000100:00100000:1.0:1789438140.804771:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769670784 00000100:00100000:0.0:1789438140.805152:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769670272 00000100:00100000:0.0:1789438140.805158:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769670272 00000100:00100000:0.0:1789438140.805189:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789438140.805199:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+18:8100:x1876361769670272:12345-0@lo:502: 00000100:00100000:0.0:1789438140.805440:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+18:8100:x1876361769670272:12345-0@lo:502: Request processed in 241us (2603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438140.805447:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789438140.805514:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769670400 00000100:00100000:1.0:1789438140.805518:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769670400 00000100:00100000:2.0:1789438140.805739:0:8100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f419a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8100:1876361769670272:0@lo:502: 00000020:01000000:2.0:1789438140.805770:0:8100:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789438140.805776:0:8100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789438140.805778:0:8100:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789438140.805783:0:8100:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:0.0:1789438140.806015:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769670528 00000100:00100000:0.0:1789438140.806020:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769670528 00000100:00100000:0.0:1789438140.806040:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789438140.806048:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769670784:12345-0@lo:400: 00000100:00100000:0.0:1789438140.806117:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769670784:12345-0@lo:400: Request processed in 69us (1624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438140.806123:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789438140.806138:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789438140.806144:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876361769670400:12345-0@lo:400: 00000100:00100000:0.0:1789438140.806186:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876361769670400:12345-0@lo:400: Request processed in 43us (1644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438140.806192:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789438140.806205:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789438140.806211:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769670528:12345-0@lo:400: 00000100:00100000:0.0:1789438140.806242:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769670528:12345-0@lo:400: Request processed in 32us (1653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438140.806248:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789438140.806266:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769670656 00000100:00100000:0.0:1789438140.806270:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769670656 00000100:00100000:0.0:1789438140.806294:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789438140.806300:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769670656:12345-0@lo:400: 00000100:00100000:0.0:1789438140.806329:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769670656:12345-0@lo:400: Request processed in 29us (1693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438140.806335:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789438140.806369:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991f3755c00 x1876361769670656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438140.806382:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769670656:0@lo:400: 00010000:00080000:0.0:1789438140.806393:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991f3754a80 x1876361769670528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438140.806401:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769670528:0@lo:400: 00010000:00080000:2.0:1789438140.808780:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991f3756a00 x1876361769670400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438140.808797:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876361769670400:0@lo:400: 00010000:00080000:2.0:1789438140.808809:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991f3754000 x1876361769670784/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438140.808818:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769670784:0@lo:400: 00000020:01000000:3.0:1789438140.812828:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1789438140.812874:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789438140.812885:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9db600/0x7a8dd0fcbb924c4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924c55 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438140.812897:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991ff9db600/0x7a8dd0fcbb924c4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924c55 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789438140.812907:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789438140.812909:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9991e1e54d40 from 1 10000000:01000000:3.0:1789438140.812912:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789438140.812961:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb924c78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438140.812970:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb924c78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438140.812980:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb924c78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438140.813001:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769670912:0@lo:101: 00000100:00100000:3.0:1789438140.813063:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438140.813424:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991de1f99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789438140.816354:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769670912 00000100:00100000:2.0:1789438140.816366:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769670912 00000100:00100000:2.0:1789438140.816432:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789438140.816441:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769670912:12345-0@lo:101: 00010000:00010000:2.0:1789438140.816456:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438140.816472:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff999202045600/0x7a8dd0fcbb924c7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924c78 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438140.816496:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff999202045600/0x7a8dd0fcbb924c7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924c78 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438140.816506:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff999202045600/0x7a8dd0fcbb924c7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924c78 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438140.816515:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999202045600, rc 0) 00000100:00100000:2.0:1789438140.816576:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:5836:x1876361769670912:12345-0@lo:101: Request processed in 136us (3513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438140.816583:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789438140.816629:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769670912:0@lo:101: 00010000:00010000:2.0:1789438140.816644:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb924c78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924c7f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438140.816653:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb924c78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924c7f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438140.816734:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f419a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769671040:0@lo:501: 00000100:00100000:2.0:1789438140.822013:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438140.822060:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c81283c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789438140.825070:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769671040 00000100:00100000:0.0:1789438140.825085:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769671040 00000100:00100000:0.0:1789438140.825198:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789438140.825208:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:5836:x1876361769671040:12345-0@lo:501: 00000100:00100000:0.0:1789438140.827783:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:5836:x1876361769671040:12345-0@lo:501: Request processed in 2569us (5768us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789438140.827797:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789438140.833471:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f419a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769671040:0@lo:501: 10000000:01000000:0.0:1789438140.833513:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789438140.833523:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb924c78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924c7f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438140.833534:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb924c78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924c7f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789438140.883772:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1789438140.884046:0:8102:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789438140.884074:0:8102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06f8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8102:1876361769671296:0@lo:7: 00000100:00100000:3.0:1789438140.884135:0:8102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438140.884160:0:8102:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991de1f99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438140.884173:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769671168:0@lo:13: 00000100:00100000:3.0:1789438140.884196:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438140.884227:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769671296 00000100:00100000:3.0:1789438140.884233:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769671296 00000100:00100000:3.0:1789438140.884278:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789438140.884285:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8102:x1876361769671296:12345-0@lo:7: 00000100:00080000:0.0:1789438140.891178:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789438140.891202:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769671168 00000100:00100000:0.0:1789438140.891212:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769671168 00000100:00100000:0.0:1789438140.891262:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789438140.891271:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1876361769671168:12345-0@lo:13: 00002000:00000024:0.0:1789438140.891304:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1789438140.891374:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1876361769671168:12345-0@lo:13: Request processed in 104us (7177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438140.891379:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789438140.900821:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991e06fb100 x1876361769671168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438156 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438140.900848:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769671168:0@lo:13: 00002000:00080000:3.0:1789438140.905186:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1789438140.905194:0:6682:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789438140.905283:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8102:x1876361769671296:12345-0@lo:7: Request processed in 20993us (21143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438140.905303:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789438140.905355:0:8102:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991e06f8e00 x1876361769671296/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789438156 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438140.905370:0:8102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06f8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8102:1876361769671296:0@lo:7: 00000004:00080000:3.0:1789438140.905384:0:8102:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789438140.905418:0:8102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06f8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8102:1876361769671424:0@lo:5: 00000100:00100000:3.0:1789438140.905449:0:8102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438140.905486:0:8102:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e5053b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789438140.905503:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769671424 00000100:00100000:3.0:1789438140.905509:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769671424 00000100:00100000:3.0:1789438140.905544:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789438140.905551:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8102:x1876361769671424:12345-0@lo:5: 00002000:00080000:3.0:1789438140.905573:0:6680:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789438140.905577:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1789438140.905833:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8102:x1876361769671424:12345-0@lo:5: Request processed in 281us (382us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789438140.905840:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789438140.905869:0:8102:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991e06f8e00 x1876361769671424/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789438156 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438140.905881:0:8102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06f8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8102:1876361769671424:0@lo:5: 00000004:00080000:3.0:1789438140.905889:0:8102:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789438140.905912:0:8102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06f8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8102:1876361769671552:0@lo:700: 00000100:00100000:3.0:1789438140.905936:0:8102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438140.905950:0:8102:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991de1f99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438140.905963:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769671552 00000100:00100000:3.0:1789438140.905973:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769671552 00000100:00100000:3.0:1789438140.906000:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789438140.906006:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8102:x1876361769671552:12345-0@lo:700: 00000100:00100000:3.0:1789438140.906033:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6688:1876361769671680:0@lo:700: 00000100:00100000:3.0:1789438140.906060:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438140.906078:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e5053b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789438140.906096:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769671680 00000100:00100000:3.0:1789438140.906100:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769671680 00000100:00100000:3.0:1789438140.906127:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789438140.906133:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6688:x1876361769671680:12345-0@lo:700: 40000000:02000000:3.0:1789438140.971183:0:5845:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1789438140.995102:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6688:x1876361769671680:12345-0@lo:700: Request processed in 88960us (89032us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438140.995130:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789438140.997117:0:6688:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991e06fad80 x1876361769671680/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789438156 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438140.997141:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6688:1876361769671680:0@lo:700: 40000000:02000000:3.0:1789438140.997155:0:6688:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:2.0:1789438141.179330:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1789438141.179347:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789438141.179476:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8102:x1876361769671552:12345-0@lo:700: Request processed in 273466us (273535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438141.179488:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789438141.180208:0:8102:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991e06f8a80 x1876361769671552/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789438156 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438141.180231:0:8102:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789438141.180250:0:8102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06f8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8102:1876361769671552:0@lo:700: 00000100:00100000:3.0:1789438141.243188:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789438141.243210:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769671808:0@lo:13: 00000100:00100000:3.0:1789438141.243267:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438141.243323:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769671808 00000100:00100000:3.0:1789438141.243330:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769671808 00000100:00100000:3.0:1789438141.243367:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789438141.243374:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769671808:12345-0@lo:13: 00002000:00000024:3.0:1789438141.243407:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789438141.243455:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769671808:12345-0@lo:13: Request processed in 81us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438141.243461:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789438141.243500:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991e06fad80 x1876361769671808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438141.243517:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769671808:0@lo:13: 00000004:02000040:2.0:1789438141.271234:0:8102:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1789438141.278403:0:8102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f419b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8102:1876361769671936:0@lo:5: 00000100:00100000:2.0:1789438141.278465:0:8102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438141.278523:0:8102:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fa8acc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789438141.282157:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769671936 00000100:00100000:3.0:1789438141.282170:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769671936 00000100:00100000:3.0:1789438141.282229:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789438141.282239:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f419ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8102:x1876361769671936:12345-0@lo:5: 00002000:00080000:3.0:1789438141.292140:0:6680:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1789438141.292160:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00010000:00010000:2.0:1789438141.304895:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438141.310422:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f419ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8102:x1876361769671936:12345-0@lo:5: Request processed in 28177us (31948us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789438141.310434:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789438141.310525:0:8102:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991f419b480 x1876361769671936/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789438157 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438141.310543:0:8102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f419b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8102:1876361769671936:0@lo:5: 00000004:00080000:3.0:1789438141.310557:0:8102:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1789438142.328320:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789438142.651003:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1789438143.351874:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438144.162984:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438144.163086:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749725568 00000100:00100000:0.0:1789438144.163095:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749725568 00000100:00100000:0.0:1789438144.163143:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 111 00000100:00100000:0.0:1789438144.163150:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2352:x1876361749725568:12345-192.168.206.9@tcp:250: 00010000:00080000:0.0:1789438144.163192:0:5831:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 58dec870-790c-4419-a02f-595f69c3b298@192.168.206.9@tcp t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:0.0:1789438144.163219:0:5831:0:(genops.c:1384:class_connect()) connect: client 58dec870-790c-4419-a02f-595f69c3b298, cookie 0x7a8dd0fcbb924c86 00000100:00080000:0.0:1789438144.163353:0:5831:0:(import.c:65:import_set_state_nolock()) ffff9990c126f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789438144.163422:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+5:2352:x1876361749725568:12345-192.168.206.9@tcp:250: Request processed in 270us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438144.163429:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 111 00000100:00100000:3.0:1789438144.177137:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438144.177239:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749725440 00000100:00100000:0.0:1789438144.177249:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749725440 00000100:00100000:0.0:1789438144.177306:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 112 00000100:00100000:0.0:1789438144.177316:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+5:5580:x1876361749725440:12345-192.168.206.9@tcp:101: 00010000:00010000:0.0:1789438144.177332:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438144.177350:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c0031a00/0x7a8dd0fcbb924c8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x483b483084eaa069 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438144.177377:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c0031a00/0x7a8dd0fcbb924c8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa069 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438144.177388:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c0031a00/0x7a8dd0fcbb924c8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa069 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438144.177396:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c0031a00, rc 0) 00000100:00100000:0.0:1789438144.177451:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+6:5580:x1876361749725440:12345-192.168.206.9@tcp:101: Request processed in 137us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438144.177458:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 112 00000100:00100000:3.0:1789438144.179943:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438144.180042:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749725696 00000100:00100000:2.0:1789438144.180054:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749725696 00000100:00100000:2.0:1789438144.180107:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 113 00000100:00100000:2.0:1789438144.180127:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+6:5580:x1876361749725696:12345-192.168.206.9@tcp:501: 00000100:00100000:2.0:1789438144.180479:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+6:5580:x1876361749725696:12345-192.168.206.9@tcp:501: Request processed in 352us (542us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789438144.180487:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 113 00000100:00100000:3.0:1789438144.192957:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438144.195437:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749725824 00000100:00100000:0.0:1789438144.195451:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749725824 00000100:00100000:2.0:1789438144.198790:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 114 00000100:00100000:2.0:1789438144.198803:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+6:5580:x1876361749725824:12345-192.168.206.9@tcp:101: 00010000:00010000:2.0:1789438144.198818:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438144.198845:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff999202045800/0x7a8dd0fcbb924c94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x483b483084eaa070 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438144.198872:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff999202045800/0x7a8dd0fcbb924c94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa070 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438144.198902:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff999202045800/0x7a8dd0fcbb924c94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa070 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438144.198912:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999202045800, rc 0) 00000100:00100000:2.0:1789438144.198975:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+7:5580:x1876361749725824:12345-192.168.206.9@tcp:101: Request processed in 174us (6024us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438144.198982:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 114 00000100:00100000:3.0:1789438144.202213:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438144.212508:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749725952 00000100:00100000:0.0:1789438144.212522:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749725952 00000100:00100000:0.0:1789438144.212594:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 115 00000100:00100000:0.0:1789438144.212604:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+7:5580:x1876361749725952:12345-192.168.206.9@tcp:501: 00000100:00100000:0.0:1789438144.215783:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+8:5580:x1876361749725952:12345-192.168.206.9@tcp:501: Request processed in 3171us (13568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438144.215796:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 115 00000100:00100000:3.0:1789438144.220776:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438144.220865:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749726080 00000100:00100000:2.0:1789438144.220874:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749726080 00000100:00100000:2.0:1789438144.220926:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 116 00000100:00100000:2.0:1789438144.220936:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+8:5580:x1876361749726080:12345-192.168.206.9@tcp:503: 00000100:00100000:2.0:1789438144.221295:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+8:5580:x1876361749726080:12345-192.168.206.9@tcp:503: Request processed in 360us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438144.221303:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 116 00000100:00100000:3.0:1789438144.225510:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438144.226055:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749726208 00000100:00100000:2.0:1789438144.226065:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749726208 00000100:00100000:2.0:1789438144.226127:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 117 00000100:00100000:2.0:1789438144.226136:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+8:5599:x1876361749726208:12345-192.168.206.9@tcp:502: 00000100:00100000:2.0:1789438144.226603:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+8:5599:x1876361749726208:12345-192.168.206.9@tcp:502: Request processed in 467us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438144.226610:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 117 00000100:00100000:3.0:1789438144.273301:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438144.273480:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749726336 00000100:00100000:2.0:1789438144.273489:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749726336 00000100:00100000:2.0:1789438144.273537:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 118 00000100:00100000:2.0:1789438144.273546:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+8:5599:x1876361749726336:12345-192.168.206.9@tcp:502: 00000100:00100000:2.0:1789438144.273860:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+8:5599:x1876361749726336:12345-192.168.206.9@tcp:502: Request processed in 314us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438144.273867:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 118 00000100:00100000:3.0:1789438144.294644:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438144.294755:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749726464 00000100:00100000:1.0:1789438144.294765:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749726464 00000100:00100000:1.0:1789438144.294818:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 119 00000100:00100000:1.0:1789438144.294840:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+8:5580:x1876361749726464:12345-192.168.206.9@tcp:101: 00010000:00010000:1.0:1789438144.294856:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438144.294872:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991ff9dbc00/0x7a8dd0fcbb924c9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x483b483084eaa09a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438144.294911:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991ff9dbc00/0x7a8dd0fcbb924c9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa09a expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438144.294921:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991ff9dbc00/0x7a8dd0fcbb924c9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa09a expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438144.294931:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9dbc00, rc 0) 00000100:00100000:1.0:1789438144.294983:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+9:5580:x1876361749726464:12345-192.168.206.9@tcp:101: Request processed in 148us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438144.294990:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 119 00000100:00100000:3.0:1789438144.299994:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438144.309880:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749726592 00000100:00100000:0.0:1789438144.309893:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749726592 00000100:00100000:0.0:1789438144.309943:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 120 00000100:00100000:0.0:1789438144.309965:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+9:5580:x1876361749726592:12345-192.168.206.9@tcp:256: 20000000:01000000:0.0:1789438144.309988:0:5833:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789438144.310009:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789438144.310013:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789438144.310016:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789438144.310018:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1789438144.312651:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+9:5580:x1876361749726592:12345-192.168.206.9@tcp:256: Request processed in 2691us (12657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438144.312665:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 120 00000100:00100000:3.0:1789438144.315744:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438144.315830:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749726720 00000100:00100000:2.0:1789438144.315844:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749726720 00000100:00100000:2.0:1789438144.315891:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 121 00000100:00100000:2.0:1789438144.315900:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+9:5580:x1876361749726720:12345-192.168.206.9@tcp:101: 00010000:00010000:2.0:1789438144.315915:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438144.315931:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff999202045a00/0x7a8dd0fcbb924ca2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x483b483084eaa0a1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438144.315955:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff999202045a00/0x7a8dd0fcbb924ca2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0a1 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438144.315966:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff999202045a00/0x7a8dd0fcbb924ca2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0a1 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438144.315975:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999202045a00, rc 0) 00000100:00100000:2.0:1789438144.316027:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+10:5580:x1876361749726720:12345-192.168.206.9@tcp:101: Request processed in 128us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438144.316034:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 121 00000100:00100000:3.0:1789438144.325300:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438144.325581:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749726848 00000100:00100000:0.0:1789438144.325592:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749726848 00000100:00100000:0.0:1789438144.325656:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 122 00000100:00100000:0.0:1789438144.325666:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+10:5580:x1876361749726848:12345-192.168.206.9@tcp:501: 00000100:00100000:0.0:1789438144.326010:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+10:5580:x1876361749726848:12345-192.168.206.9@tcp:501: Request processed in 344us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438144.326018:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 122 00000100:00100000:3.0:1789438144.327926:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438144.328002:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749726976 00000100:00100000:1.0:1789438144.328009:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749726976 00000100:00100000:1.0:1789438144.328054:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 123 00000100:00100000:1.0:1789438144.328062:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+10:5580:x1876361749726976:12345-192.168.206.9@tcp:503: 00000100:00100000:1.0:1789438144.328394:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+10:5580:x1876361749726976:12345-192.168.206.9@tcp:503: Request processed in 332us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438144.328403:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 123 00000100:00100000:3.0:1789438144.333498:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438144.337736:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749727104 00000100:00100000:2.0:1789438144.337749:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749727104 00000100:00100000:2.0:1789438144.337815:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 124 00000100:00100000:2.0:1789438144.337933:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+10:5603:x1876361749727104:12345-192.168.206.9@tcp:502: 00000100:00100000:2.0:1789438144.338369:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+10:5603:x1876361749727104:12345-192.168.206.9@tcp:502: Request processed in 438us (4880us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438144.338386:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 124 00000100:00100000:3.0:1789438144.344181:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438144.344362:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749727232 00000100:00100000:0.0:1789438144.344371:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749727232 00000100:00100000:0.0:1789438144.344422:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 125 00000100:00100000:0.0:1789438144.344441:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+10:5603:x1876361749727232:12345-192.168.206.9@tcp:502: 00000100:00100000:0.0:1789438144.344660:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+10:5603:x1876361749727232:12345-192.168.206.9@tcp:502: Request processed in 219us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438144.344668:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 125 00000100:00100000:3.0:1789438144.349913:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438144.350010:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749727360 00000100:00100000:1.0:1789438144.350019:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749727360 00000100:00100000:1.0:1789438144.350063:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:1.0:1789438144.350071:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2352:x1876361749727360:12345-192.168.206.9@tcp:38: 00010000:00080000:1.0:1789438144.350109:0:5838:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 1274be99-2d57-4dac-a13e-a89426512ee0@192.168.206.9@tcp t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:1.0:1789438144.350151:0:5838:0:(genops.c:1384:class_connect()) connect: client 1274be99-2d57-4dac-a13e-a89426512ee0, cookie 0x7a8dd0fcbb924ca9 00000004:00100000:1.0:1789438144.350177:0:5838:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:1.0:1789438144.350183:0:5838:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1789438144.376672:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789438144.438987:0:5838:0:(import.c:65:import_set_state_nolock()) ffff9990c1cc1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789438144.439055:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+6:2352:x1876361749727360:12345-192.168.206.9@tcp:38: Request processed in 88982us (89149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438144.439065:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:3.0:1789438144.954152:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438144.954219:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438144.954329:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749727488 00000100:00100000:0.0:1789438144.954338:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749727488 00000100:00100000:0.0:1789438144.954410:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749727616 00000100:00100000:0.0:1789438144.954413:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749727616 00000100:00100000:0.0:1789438144.954435:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 5 00000100:00100000:0.0:1789438144.954444:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+7:0:x1876361749727488:12345-192.168.206.9@tcp:41: 00000004:00000024:0.0:1789438144.954494:0:7624:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789438144.954567:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+7:0:x1876361749727488:12345-192.168.206.9@tcp:41: Request processed in 124us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438144.954575:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 5 00000100:00100000:0.0:1789438144.954592:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 6 00000100:00100000:0.0:1789438144.954599:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+6:5580:x1876361749727616:12345-192.168.206.9@tcp:41: 00000004:00000024:0.0:1789438144.954610:0:7624:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789438144.954632:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+6:5580:x1876361749727616:12345-192.168.206.9@tcp:41: Request processed in 33us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438144.954638:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 6 00000100:00080000:2.0:1789438144.954920:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789438144.958289:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438144.958388:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749727744 00000100:00100000:1.0:1789438144.958397:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749727744 00000100:00100000:1.0:1789438144.958453:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:1.0:1789438144.958472:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+6:5580:x1876361749727744:12345-192.168.206.9@tcp:40: 00000100:00100000:1.0:1789438144.958561:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+6:5580:x1876361749727744:12345-192.168.206.9@tcp:40: Request processed in 93us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438144.958569:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:3.0:1789438144.964798:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438144.964866:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438144.966418:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749728256 00000100:00100000:2.0:1789438144.966430:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749728256 00000100:00100000:2.0:1789438144.966503:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 126 00000100:00100000:2.0:1789438144.966513:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+10:2355:x1876361749728256:12345-192.168.206.9@tcp:400: 00000100:00100000:2.0:1789438144.966596:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+10:2355:x1876361749728256:12345-192.168.206.9@tcp:400: Request processed in 84us (1728us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438144.966604:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 126 00000100:00100000:3.0:1789438144.968332:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438144.968391:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749727872 00000100:00100000:2.0:1789438144.968398:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749727872 00000100:00100000:3.0:1789438144.968426:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438144.968429:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 8 00000100:00100000:2.0:1789438144.968436:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1876361749727872:12345-192.168.206.9@tcp:8: 00000100:00100000:3.0:1789438144.968461:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789438144.968469:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:2.0:1789438144.968474:0:6682:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 1274be99-2d57-4dac-a13e-a89426512ee0@192.168.206.9@tcp t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:2.0:1789438144.968502:0:6682:0:(genops.c:1384:class_connect()) connect: client 1274be99-2d57-4dac-a13e-a89426512ee0, cookie 0x7a8dd0fcbb924cb0 00002000:00100000:2.0:1789438144.968514:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1274be99-2d57-4dac-a13e-a89426512ee0/ffff9990c1cc2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789438144.968537:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:2.0:1789438144.968919:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789438144.968946:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9990c1cc4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789438144.968997:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+6:2352:x1876361749727872:12345-192.168.206.9@tcp:8: Request processed in 559us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438144.969014:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 8 00000100:00100000:2.0:1789438144.969030:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749728000 00000100:00100000:2.0:1789438144.969034:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749728000 00000100:00100000:2.0:1789438144.969047:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:2.0:1789438144.969051:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1876361749728000:12345-192.168.206.9@tcp:8: 00010000:00080000:2.0:1789438144.969066:0:6682:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 1274be99-2d57-4dac-a13e-a89426512ee0@192.168.206.9@tcp t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:2.0:1789438144.969082:0:6682:0:(genops.c:1384:class_connect()) connect: client 1274be99-2d57-4dac-a13e-a89426512ee0, cookie 0x7a8dd0fcbb924cb7 00002000:00100000:2.0:1789438144.969087:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1274be99-2d57-4dac-a13e-a89426512ee0/ffff9990c1cc5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789438144.969100:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:2.0:1789438144.969319:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789438144.969336:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9990c1cc5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789438144.969378:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+6:2352:x1876361749728000:12345-192.168.206.9@tcp:8: Request processed in 324us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438144.969385:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:1.0:1789438144.970405:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749728128 00000100:00100000:1.0:1789438144.970413:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749728128 00000100:00100000:1.0:1789438144.970466:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00100000:1.0:1789438144.970475:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+6:5580:x1876361749728128:12345-192.168.206.9@tcp:33: 00000004:00080000:1.0:1789438144.993398:0:5841:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 22866us 00000004:00200000:0.0:1789438145.003425:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789438145.003528:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+6:5580:x1876361749728128:12345-192.168.206.9@tcp:33: Request processed in 33049us (38732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438145.003542:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00100000:0.0:1789438145.172858:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438145.173091:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749728384 00000100:00100000:2.0:1789438145.173103:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749728384 00000100:00100000:2.0:1789438145.173159:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 8 00000100:00100000:2.0:1789438145.173169:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+6:5620:x1876361749728384:12345-192.168.206.9@tcp:101: 00010000:00010000:2.0:1789438145.173188:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438145.173251:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999202044800/0x7a8dd0fcbb924cbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa0cb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438145.173316:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff999202044000/0x7a8dd0fcbb924cc5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438145.173330:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff999202044000/0x7a8dd0fcbb924cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438145.173351:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff999202044000/0x7a8dd0fcbb924cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438145.173384:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789438145.173388:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789438145.173403:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff999202044000/0x7a8dd0fcbb924cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438145.173426:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999202044800/0x7a8dd0fcbb924cbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0cb expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438145.173445:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff999202044000/0x7a8dd0fcbb924cc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0cb expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438145.173454:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872800) 00010000:00010000:2.0:1789438145.173457:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789438145.173461:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999202044000, rc 0) 00000100:00100000:2.0:1789438145.173523:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+7:5620:x1876361749728384:12345-192.168.206.9@tcp:101: Request processed in 355us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438145.173530:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 8 00010000:00010000:3.0:1789438145.399006:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438145.847058:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f419a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876361769672192:0@lo:400: 00000100:00100000:0.0:1789438145.847133:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438145.847194:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769672704:0@lo:400: 00000100:00100000:0.0:1789438145.847235:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438145.847265:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789438145.847271:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f4198a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769672320:0@lo:400: 00000100:00100000:0.0:1789438145.847293:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438145.847324:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769672192 00000100:00100000:0.0:1789438145.847331:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769672192 00000100:00100000:0.0:1789438145.847383:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769672320 00000100:00100000:0.0:1789438145.847386:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769672320 00000100:00100000:0.0:1789438145.847416:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789438145.847424:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876361769672192:12345-0@lo:400: 00000100:00100000:0.0:1789438145.847470:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876361769672192:12345-0@lo:400: Request processed in 47us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438145.847476:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789438145.847811:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789438145.847818:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769672320:12345-0@lo:400: 00000100:00100000:0.0:1789438145.847850:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769672320:12345-0@lo:400: Request processed in 33us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438145.847856:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1789438145.847872:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789438145.847902:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f4198a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769672320:0@lo:400: 00000100:00100000:0.0:1789438145.847913:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f419a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876361769672192:0@lo:400: 00000100:00100000:1.0:1789438145.847992:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769672448:0@lo:400: 00000100:00100000:1.0:1789438145.848020:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438145.848052:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789438145.848058:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f419aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769672064:0@lo:400: 00000100:00100000:1.0:1789438145.848082:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438145.848103:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa646a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876361769672576:0@lo:400: 00000100:00100000:1.0:1789438145.848121:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438145.848144:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769672064 00000100:00100000:1.0:1789438145.848147:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769672064 00000100:00100000:1.0:1789438145.848173:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789438145.848180:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3309:x1876361769672064:12345-0@lo:400: 00000100:00100000:1.0:1789438145.848212:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3309:x1876361769672064:12345-0@lo:400: Request processed in 32us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438145.848218:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789438145.848263:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f419aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769672064:0@lo:400: 00000100:00100000:2.0:1789438145.848332:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769672576 00000100:00100000:2.0:1789438145.848336:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769672576 00000100:00100000:2.0:1789438145.848378:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789438145.848385:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876361769672576:12345-0@lo:400: 00000100:00100000:2.0:1789438145.848424:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876361769672576:12345-0@lo:400: Request processed in 39us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438145.848431:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789438145.848458:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769672704 00000100:00100000:2.0:1789438145.848462:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769672704 00000100:00100000:2.0:1789438145.848498:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769672448 00000100:00100000:2.0:1789438145.848501:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769672448 00000100:00100000:2.0:1789438145.848518:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789438145.848524:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769672704:12345-0@lo:400: 00000100:00100000:2.0:1789438145.848556:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769672704:12345-0@lo:400: Request processed in 32us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438145.848561:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789438145.848572:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789438145.848577:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769672448:12345-0@lo:400: 00000100:00100000:2.0:1789438145.848603:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769672448:12345-0@lo:400: Request processed in 26us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438145.848609:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789438145.848831:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa646a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876361769672576:0@lo:400: 00010000:00080000:2.0:1789438145.848842:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991fa647100 x1876361769672448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438145.848852:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769672448:0@lo:400: 00000100:00080000:1.0:1789438145.848957:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789438145.848961:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789438145.848963:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789438145.849156:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991fa645500 x1876361769672704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438145.849179:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789438145.849195:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769672704:0@lo:400: 00000100:00100000:0.0:1789438146.361472:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789438146.361506:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f419b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769672832:0@lo:13: 00000100:00100000:0.0:1789438146.361569:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438146.361804:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769672832 00000100:00100000:0.0:1789438146.361812:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769672832 00000100:00100000:0.0:1789438146.361855:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789438146.361864:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f419aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769672832:12345-0@lo:13: 00002000:00000024:0.0:1789438146.361885:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438146.361927:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f419aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769672832:12345-0@lo:13: Request processed in 64us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438146.361934:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789438146.361973:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991f419b480 x1876361769672832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438146.361989:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f419b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769672832:0@lo:13: 00000100:00100000:1.0:1789438146.362901:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769672960:0@lo:13: 00000100:00100000:1.0:1789438146.362942:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438146.363019:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769672960 00000100:00100000:2.0:1789438146.363025:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769672960 00000100:00100000:2.0:1789438146.363063:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789438146.363070:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769672960:12345-0@lo:13: 00002000:00000024:2.0:1789438146.363083:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789438146.363142:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769672960:12345-0@lo:13: Request processed in 73us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438146.363149:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789438146.363191:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991fa647100 x1876361769672960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438146.363217:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769672960:0@lo:13: 00010000:00010000:1.0:1789438146.426520:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789438146.491050:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1274be99-2d57-4dac-a13e-a89426512ee0 00010000:00010000:3.0:1789438147.446918:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438147.633357:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438147.633462:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749728512 00000100:00100000:2.0:1789438147.633471:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749728512 00000100:00100000:2.0:1789438147.633547:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:2.0:1789438147.633557:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f419b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+7:5672:x1876361749728512:12345-192.168.206.9@tcp:41: 00000004:00000024:2.0:1789438147.633596:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789438147.633661:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f419b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+7:5672:x1876361749728512:12345-192.168.206.9@tcp:41: Request processed in 105us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438147.633669:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00080000:1.0:1789438147.634097:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789438147.640545:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438147.640648:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749728640 00000100:00100000:2.0:1789438147.640658:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749728640 00000100:00100000:2.0:1789438147.640761:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:2.0:1789438147.640777:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f419a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1274be99-2d57-4dac-a13e-a89426512ee0+5:5672:x1876361749728640:12345-192.168.206.9@tcp:13: 00000100:00080000:1.0:1789438147.641306:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1789438147.641502:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789438147.641575:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f419a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1274be99-2d57-4dac-a13e-a89426512ee0+5:5672:x1876361749728640:12345-192.168.206.9@tcp:13: Request processed in 802us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438147.641583:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:0.0:1789438147.645736:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438147.645946:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749728768 00000100:00100000:1.0:1789438147.645956:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749728768 00000100:00100000:1.0:1789438147.646026:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:1.0:1789438147.646037:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4198a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1274be99-2d57-4dac-a13e-a89426512ee0+6:5672:x1876361749728768:12345-192.168.206.9@tcp:13: 00002000:00000024:1.0:1789438147.646072:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789438147.646277:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4198a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1274be99-2d57-4dac-a13e-a89426512ee0+6:5672:x1876361749728768:12345-192.168.206.9@tcp:13: Request processed in 241us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438147.646286:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00080000:0.0:1789438147.647835:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789438148.475917:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789438148.979963:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1274be99-2d57-4dac-a13e-a89426512ee0 00010000:00010000:2.0:1789438149.494899:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789438149.543587:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1274be99-2d57-4dac-a13e-a89426512ee0 00000100:00100000:0.0:1789438150.121441:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438150.121504:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438150.121539:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438150.121565:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438150.121627:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749729024 00000100:00100000:1.0:1789438150.121635:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749729024 00000100:00100000:1.0:1789438150.121738:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 23 00000100:00100000:1.0:1789438150.121749:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+6:2356:x1876361749729024:12345-192.168.206.9@tcp:400: 00000100:00100000:1.0:1789438150.121810:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+6:2356:x1876361749729024:12345-192.168.206.9@tcp:400: Request processed in 64us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438150.121817:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 23 00000100:00100000:2.0:1789438150.121966:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749728896 00000100:00100000:2.0:1789438150.121971:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749728896 00000100:00100000:2.0:1789438150.121995:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 128 00000100:00100000:2.0:1789438150.122001:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+10:2355:x1876361749728896:12345-192.168.206.9@tcp:400: 00000100:00100000:2.0:1789438150.122027:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+10:2355:x1876361749728896:12345-192.168.206.9@tcp:400: Request processed in 26us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438150.122041:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 128 00000100:00100000:2.0:1789438150.122081:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749729152 00000100:00100000:2.0:1789438150.122084:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749729152 00000100:00100000:2.0:1789438150.122107:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749729280 00000100:00100000:2.0:1789438150.122109:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749729280 00000100:00100000:2.0:1789438150.122127:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:2.0:1789438150.122133:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+5:2355:x1876361749729152:12345-192.168.206.9@tcp:400: 00000100:00100000:2.0:1789438150.122158:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+5:2355:x1876361749729152:12345-192.168.206.9@tcp:400: Request processed in 25us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438150.122164:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:2.0:1789438150.122175:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 8 00000100:00100000:2.0:1789438150.122180:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+5:2356:x1876361749729280:12345-192.168.206.9@tcp:400: 00000100:00100000:2.0:1789438150.122198:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+5:2356:x1876361749729280:12345-192.168.206.9@tcp:400: Request processed in 18us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438150.122215:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 8 00000100:00080000:0.0:1789438150.122801:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789438150.122807:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789438150.122818:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789438150.531549:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789438150.951277:0:8284:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1789438150.967006:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876361769673216:0@lo:400: 00000100:00100000:0.0:1789438150.967071:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438150.967120:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769673728:0@lo:400: 00000100:00100000:0.0:1789438150.967143:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438150.967171:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789438150.967176:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769673344:0@lo:400: 00000100:00100000:0.0:1789438150.967196:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438150.967227:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769673216 00000100:00100000:0.0:1789438150.967234:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769673216 00000100:00100000:0.0:1789438150.967274:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769673344 00000100:00100000:0.0:1789438150.967277:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769673344 00000100:00100000:0.0:1789438150.967304:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789438150.967311:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876361769673216:12345-0@lo:400: 00000100:00100000:0.0:1789438150.967359:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876361769673216:12345-0@lo:400: Request processed in 48us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438150.967367:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789438150.967382:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789438150.967387:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769673344:12345-0@lo:400: 00000100:00100000:0.0:1789438150.967413:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769673344:12345-0@lo:400: Request processed in 26us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438150.967418:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789438150.967434:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769673728 00000100:00100000:0.0:1789438150.967437:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769673728 00000100:00100000:0.0:1789438150.967463:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789438150.967486:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769673728:12345-0@lo:400: 00000100:00100000:0.0:1789438150.967515:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769673728:12345-0@lo:400: Request processed in 31us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438150.967533:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1789438150.967552:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789438150.967556:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789438150.967583:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769673344:0@lo:400: 00000100:00100000:0.0:1789438150.967609:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876361769673216:0@lo:400: 00010000:00080000:0.0:1789438150.967621:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff86ed80 x1876361769673728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438150.967631:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769673728:0@lo:400: 00000100:00100000:2.0:1789438150.967846:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769673472:0@lo:400: 00000100:00100000:2.0:1789438150.967877:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438150.967898:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789438150.967903:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769673088:0@lo:400: 00000100:00100000:2.0:1789438150.967929:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438150.967952:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876361769673600:0@lo:400: 00000100:00100000:2.0:1789438150.967971:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438150.968115:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769673088 00000100:00100000:3.0:1789438150.968120:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769673088 00000100:00100000:3.0:1789438150.968155:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789438150.968163:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3309:x1876361769673088:12345-0@lo:400: 00000100:00100000:3.0:1789438150.968201:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3309:x1876361769673088:12345-0@lo:400: Request processed in 40us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438150.968208:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789438150.968240:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769673088:0@lo:400: 00000100:00100000:0.0:1789438150.968435:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769673472 00000100:00100000:0.0:1789438150.968440:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769673472 00000100:00100000:0.0:1789438150.968493:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789438150.968499:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769673472:12345-0@lo:400: 00000100:00100000:0.0:1789438150.968535:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769673472:12345-0@lo:400: Request processed in 36us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438150.968541:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789438150.968557:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769673600 00000100:00100000:0.0:1789438150.968560:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769673600 00000100:00100000:0.0:1789438150.968582:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789438150.968587:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876361769673600:12345-0@lo:400: 00000100:00080000:2.0:1789438150.968793:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789438150.968806:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789438150.968867:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff86df80 x1876361769673472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438150.968879:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769673472:0@lo:400: 00000100:00100000:0.0:1789438150.968995:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876361769673600:12345-0@lo:400: Request processed in 407us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438150.969002:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789438150.969074:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876361769673600:0@lo:400: 00000100:00100000:0.0:1789438151.480355:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fabc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769673856:0@lo:13: 00000100:00100000:0.0:1789438151.480419:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438151.480537:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769673856 00000100:00100000:3.0:1789438151.480545:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769673856 00000100:00100000:3.0:1789438151.480605:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789438151.480614:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769673856:12345-0@lo:13: 00002000:00000024:3.0:1789438151.480648:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789438151.480739:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769673856:12345-0@lo:13: Request processed in 94us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438151.480746:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789438151.480791:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991fabc9180 x1876361769673856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438151.480809:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fabc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769673856:0@lo:13: 00000100:00100000:3.0:1789438151.482492:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789438151.482513:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769673984:0@lo:13: 00000100:00100000:3.0:1789438151.482567:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438151.482799:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769673984 00000100:00100000:0.0:1789438151.482819:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769673984 00000100:00100000:0.0:1789438151.482877:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789438151.482886:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769673984:12345-0@lo:13: 00002000:00000024:0.0:1789438151.482915:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438151.482957:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769673984:12345-0@lo:13: Request processed in 73us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438151.482964:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789438151.483396:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff86d180 x1876361769673984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438151.483413:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769673984:0@lo:13: 00010000:00010000:2.0:1789438151.543098:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438152.577309:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438153.593844:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438154.615073:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438155.228242:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438155.228274:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438155.228297:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438155.228316:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438155.228340:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749729664 00000100:00100000:0.0:1789438155.228350:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749729664 00000100:00100000:0.0:1789438155.228401:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749729792 00000100:00100000:0.0:1789438155.228404:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749729792 00000100:00100000:0.0:1789438155.228427:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 11 00000100:00100000:0.0:1789438155.228436:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+5:2353:x1876361749729664:12345-192.168.206.9@tcp:400: 00000100:00100000:0.0:1789438155.228498:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+5:2353:x1876361749729664:12345-192.168.206.9@tcp:400: Request processed in 64us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438155.228505:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 11 00000100:00100000:0.0:1789438155.228520:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 12 00000100:00100000:0.0:1789438155.228526:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+5:2353:x1876361749729792:12345-192.168.206.9@tcp:400: 00000100:00100000:0.0:1789438155.228549:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+5:2353:x1876361749729792:12345-192.168.206.9@tcp:400: Request processed in 24us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438155.228554:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 12 00000100:00100000:0.0:1789438155.228571:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749729536 00000100:00100000:0.0:1789438155.228575:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749729536 00000100:00100000:0.0:1789438155.228626:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 27 00000100:00100000:0.0:1789438155.228632:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+6:2353:x1876361749729536:12345-192.168.206.9@tcp:400: 00000100:00100000:0.0:1789438155.228673:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+6:2353:x1876361749729536:12345-192.168.206.9@tcp:400: Request processed in 42us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438155.228680:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 27 00000100:00080000:0.0:1789438155.228701:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789438155.228705:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789438155.228731:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789438155.231397:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749729408 00000100:00100000:1.0:1789438155.231409:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749729408 00000100:00100000:1.0:1789438155.231461:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 130 00000100:00100000:1.0:1789438155.231470:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1facc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+10:2353:x1876361749729408:12345-192.168.206.9@tcp:400: 00000100:00100000:1.0:1789438155.231530:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1facc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+10:2353:x1876361749729408:12345-192.168.206.9@tcp:400: Request processed in 61us (3297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438155.231538:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 130 00000020:00000080:2.0:1789438155.420444:0:8433:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc69ebf030 20000000:00000080:2.0:1789438155.420461:0:8433:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9991f41d7000 uarg=0000000000000000 20000000:01000000:2.0:1789438155.420944:0:8433:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1789438155.420947:0:8433:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1789438155.420950:0:8433:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789438155.420954:0:8433:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789438155.420959:0:8433:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1789438155.420975:0:8433:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789438155.420978:0:8433:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789438155.421173:0:8433:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789438155.421176:0:8433:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789438155.421974:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1789438155.424081:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1789438155.424140:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1789438155.424173:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1789438155.424187:0:8433:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789438155.424190:0:8433:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789438155.425064:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1789438155.425401:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1789438155.425452:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1789438155.425491:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1789438155.425505:0:8433:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789438155.425508:0:8433:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789438155.426431:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1789438155.427113:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1789438155.427160:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1789438155.427212:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1789438155.427227:0:8433:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789438155.427229:0:8433:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789438155.429231:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1789438155.429974:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1789438155.430041:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1789438155.430082:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:0.0:1789438155.430100:0:8433:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789438155.430120:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9991c0031e00/0x7a8dd0fcbb924ccc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.430138:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff999202044400/0x7a8dd0fcbb924bc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924bc2 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.430152:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991c0030e00/0x7a8dd0fcbb924bf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924bec expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.430159:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff999202045c00/0x7a8dd0fcbb924c1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924c16 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.430165:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb924c2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924c24 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.430172:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991c2a54a00/0x7a8dd0fcbb924c39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924c32 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.430179:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991c2a54200/0x7a8dd0fcbb924c55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924c4e expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.430186:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff999202045600/0x7a8dd0fcbb924c7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924c78 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.430195:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991c0031a00/0x7a8dd0fcbb924c8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa069 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.430202:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff999202045800/0x7a8dd0fcbb924c94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa070 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.430209:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9991c0031e00/0x7a8dd0fcbb924ccc lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.430245:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff999202045800/0x7a8dd0fcbb924c94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa070 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.430270:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff999202045800/0x7a8dd0fcbb924c94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa070 expref: 9 pid: 5832 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438155.430286:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1876361769674112:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438155.430430:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991c0031a00/0x7a8dd0fcbb924c8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa069 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.430439:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9991c0031a00/0x7a8dd0fcbb924c8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa069 expref: 9 pid: 5832 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438155.430447:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1876361769674240:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438155.430474:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff999202045600/0x7a8dd0fcbb924c7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb924c78 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.430482:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff999202045600/0x7a8dd0fcbb924c7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924c78 expref: 18 pid: 5833 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438155.430489:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1876361769674368:0@lo:104: 00000100:00100000:0.0:1789438155.430521:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789438155.430560:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991c2a54200/0x7a8dd0fcbb924c55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb924c4e expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.430568:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9991c2a54200/0x7a8dd0fcbb924c55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924c4e expref: 18 pid: 5832 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438155.430661:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1876361769674496:0@lo:104: 00000100:00100000:0.0:1789438155.430684:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789438155.430746:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991c2a54a00/0x7a8dd0fcbb924c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb924c32 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.430755:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9991c2a54a00/0x7a8dd0fcbb924c39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924c32 expref: 18 pid: 5832 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438155.430762:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1876361769674624:0@lo:104: 00010000:00010000:0.0:1789438155.430919:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb924c2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb924c24 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.430927:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb924c2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924c24 expref: 18 pid: 5833 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438155.430934:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1876361769674752:0@lo:104: 00010000:00010000:0.0:1789438155.430958:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff999202045c00/0x7a8dd0fcbb924c1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb924c16 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.430965:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff999202045c00/0x7a8dd0fcbb924c1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924c16 expref: 18 pid: 5833 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438155.430973:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1876361769674880:0@lo:104: 00010000:00010000:0.0:1789438155.431008:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991c0030e00/0x7a8dd0fcbb924bf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb924bec expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.431016:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9991c0030e00/0x7a8dd0fcbb924bf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924bec expref: 18 pid: 5832 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438155.431026:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff913100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1876361769675008:0@lo:104: 00010000:00010000:0.0:1789438155.431053:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff999202044400/0x7a8dd0fcbb924bc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb924bc2 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.431071:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff999202044400/0x7a8dd0fcbb924bc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924bc2 expref: 18 pid: 5832 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438155.431080:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff912a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1876361769675136:0@lo:104: 00000100:00100000:0.0:1789438155.431101:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c6d5d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789438155.431248:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789438155.431266:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438155.431281:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438155.431289:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438155.431296:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438155.431303:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438155.431313:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769674368 00000100:00100000:2.0:1789438155.431319:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769674368 00000100:00100000:2.0:1789438155.431351:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769674496 00000100:00100000:2.0:1789438155.431354:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769674496 00000100:00100000:2.0:1789438155.431364:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769674624 00000100:00100000:2.0:1789438155.431367:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769674624 00000100:00100000:2.0:1789438155.431375:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769674752 00000100:00100000:2.0:1789438155.431377:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769674752 00000100:00100000:2.0:1789438155.431386:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769674880 00000100:00100000:2.0:1789438155.431388:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769674880 00000100:00100000:2.0:1789438155.431396:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769675008 00000100:00100000:2.0:1789438155.431399:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769675008 00000100:00100000:2.0:1789438155.431408:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769675136 00000100:00100000:2.0:1789438155.431410:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769675136 00000100:00100000:2.0:1789438155.431435:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789438155.431442:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+9:8433:x1876361769674368:12345-0@lo:104: 00010000:00010000:2.0:1789438155.431454:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb924c78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924c7f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.431506:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789438155.431512:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+9:8433:x1876361769674368:12345-0@lo:104: Request processed in 71us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438155.431518:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789438155.431536:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789438155.431543:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+8:8433:x1876361769674496:12345-0@lo:104: 00010000:00010000:2.0:1789438155.431551:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9991ff9db600/0x7a8dd0fcbb924c4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924c55 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.431602:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789438155.431608:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+8:8433:x1876361769674496:12345-0@lo:104: Request processed in 66us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438155.431613:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789438155.431662:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789438155.431668:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa646300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+7:8433:x1876361769674624:12345-0@lo:104: 00010000:00010000:2.0:1789438155.431675:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924c32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924c39 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.431700:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789438155.431705:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa646300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+7:8433:x1876361769674624:12345-0@lo:104: Request processed in 38us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438155.431727:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789438155.431741:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789438155.431753:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa644000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+6:8433:x1876361769674752:12345-0@lo:104: 00010000:00010000:2.0:1789438155.431761:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9991c2a55800/0x7a8dd0fcbb924c24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924c2b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.431923:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789438155.431928:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa644000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+6:8433:x1876361769674752:12345-0@lo:104: Request processed in 176us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438155.431934:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789438155.431948:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789438155.431953:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa644380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+5:8433:x1876361769674880:12345-0@lo:104: 00010000:00010000:2.0:1789438155.431961:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9991ff9dbe00/0x7a8dd0fcbb924c16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924c1d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.431985:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789438155.431990:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa644380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+5:8433:x1876361769674880:12345-0@lo:104: Request processed in 37us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438155.431995:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789438155.432007:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789438155.432012:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa647b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+4:8433:x1876361769675008:12345-0@lo:104: 00010000:00010000:2.0:1789438155.432019:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924bec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924bf3 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432058:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1789438155.432063:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa647b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+4:8433:x1876361769675008:12345-0@lo:104: Request processed in 52us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438155.432068:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789438155.432081:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789438155.432093:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa645c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+3:8433:x1876361769675136:12345-0@lo:104: 00010000:00010000:2.0:1789438155.432100:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9991ff9da000/0x7a8dd0fcbb924bc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924bc9 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432126:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1789438155.432130:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa645c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+3:8433:x1876361769675136:12345-0@lo:104: Request processed in 39us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438155.432136:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789438155.432156:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789438155.432161:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb924c78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924c7f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432167:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55a00 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:2.0:1789438155.432171:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb924c78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb924c7f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432179:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb924c78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb924c7f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789438155.432185:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb924c78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb924c7f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789438155.432191:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789438155.432217:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb924c78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924c7f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432223:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789438155.432238:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb924c78 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924c7f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432253:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb924c78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924c7f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432266:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789438155.432269:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991ff9db600/0x7a8dd0fcbb924c4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924c55 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432274:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9db600 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:2.0:1789438155.432277:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991ff9db600/0x7a8dd0fcbb924c4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb924c55 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432283:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991ff9db600/0x7a8dd0fcbb924c4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb924c55 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789438155.432290:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991ff9db600/0x7a8dd0fcbb924c4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb924c55 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789438155.432294:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789438155.432306:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991ff9db600/0x7a8dd0fcbb924c4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924c55 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432311:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789438155.432324:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991ff9db600/0x7a8dd0fcbb924c4e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924c55 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432330:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991ff9db600/0x7a8dd0fcbb924c4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924c55 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432338:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789438155.432345:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924c32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924c39 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432351:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999202045200 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:2.0:1789438155.432354:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924c32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb924c39 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432360:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924c32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb924c39 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789438155.432365:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924c32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb924c39 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789438155.432370:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789438155.432381:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924c32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924c39 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432387:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789438155.432392:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924c32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924c39 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432398:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924c32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924c39 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432406:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789438155.432409:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991c2a55800/0x7a8dd0fcbb924c24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924c2b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432413:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55800 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:2.0:1789438155.432415:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991c2a55800/0x7a8dd0fcbb924c24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb924c2b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432431:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991c2a55800/0x7a8dd0fcbb924c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb924c2b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789438155.432437:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991c2a55800/0x7a8dd0fcbb924c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb924c2b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789438155.432441:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789438155.432452:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991c2a55800/0x7a8dd0fcbb924c24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924c2b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432456:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789438155.432461:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991c2a55800/0x7a8dd0fcbb924c24 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924c2b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432466:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991c2a55800/0x7a8dd0fcbb924c24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924c2b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432473:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789438155.432475:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991ff9dbe00/0x7a8dd0fcbb924c16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924c1d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432480:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dbe00 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:2.0:1789438155.432482:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991ff9dbe00/0x7a8dd0fcbb924c16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb924c1d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432488:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991ff9dbe00/0x7a8dd0fcbb924c16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb924c1d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789438155.432493:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991ff9dbe00/0x7a8dd0fcbb924c16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb924c1d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789438155.432502:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789438155.432511:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991ff9dbe00/0x7a8dd0fcbb924c16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924c1d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432516:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789438155.432519:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991ff9dbe00/0x7a8dd0fcbb924c16 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924c1d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432525:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991ff9dbe00/0x7a8dd0fcbb924c16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924c1d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432531:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789438155.432533:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924bec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924bf3 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432538:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c0031400 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:2.0:1789438155.432541:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924bec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb924bf3 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432548:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924bec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb924bf3 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789438155.432554:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924bec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb924bf3 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789438155.432559:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789438155.432568:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924bec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924bf3 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432574:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789438155.432601:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924bec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924bf3 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432608:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991c0031400/0x7a8dd0fcbb924bec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924bf3 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432617:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789438155.432620:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991ff9da000/0x7a8dd0fcbb924bc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924bc9 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432625:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9da000 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:2.0:1789438155.432628:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991ff9da000/0x7a8dd0fcbb924bc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb924bc9 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432635:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991ff9da000/0x7a8dd0fcbb924bc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb924bc9 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789438155.432641:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991ff9da000/0x7a8dd0fcbb924bc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb924bc9 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789438155.432655:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789438155.432668:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991ff9da000/0x7a8dd0fcbb924bc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924bc9 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432674:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789438155.432678:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991ff9da000/0x7a8dd0fcbb924bc2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924bc9 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432683:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991ff9da000/0x7a8dd0fcbb924bc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924bc9 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.432696:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438155.432703:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438155.432705:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438155.432735:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438155.432757:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769675264:0@lo:103: 00000100:00100000:2.0:1789438155.435331:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438155.435436:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769675776:0@lo:103: 00000100:00100000:2.0:1789438155.435462:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438155.435546:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1876361769674368:0@lo:104: 00000100:00100000:0.0:1789438155.435556:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1876361769674496:0@lo:104: 00000100:00100000:0.0:1789438155.435563:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1876361769674624:0@lo:104: 00000100:00100000:0.0:1789438155.435590:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1876361769674752:0@lo:104: 00000100:00100000:0.0:1789438155.435598:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1876361769674880:0@lo:104: 00000100:00100000:0.0:1789438155.435606:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff913100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1876361769675008:0@lo:104: 00000100:00100000:0.0:1789438155.435612:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff912a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1876361769675136:0@lo:104: 00000100:00100000:3.0:1789438155.437922:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769675392:0@lo:103: 00000100:00100000:3.0:1789438155.437985:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769675648:0@lo:103: 00000100:00100000:2.0:1789438155.438224:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa646680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769675520:0@lo:103: 00000100:00100000:2.0:1789438155.438253:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438155.438357:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769675264 00000100:00100000:1.0:1789438155.438365:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769675264 00000100:00100000:1.0:1789438155.440437:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769675776 00000100:00100000:1.0:1789438155.440449:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769675776 00010000:00010000:1.0:1789438155.440494:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff999202045c00/0x7a8dd0fcbb924c1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924c16 expref: 20 pid: 5833 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438155.440517:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769675520 00000100:00100000:1.0:1789438155.440520:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769675520 00010000:00010000:1.0:1789438155.440531:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991c2a54a00/0x7a8dd0fcbb924c39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924c32 expref: 21 pid: 5832 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438155.440544:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789438155.440552:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa644e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7073a0da-08cf-42fe-8791-a8c6139408f2+21:3310:x1876361769675776:12345-0@lo:103: 00010000:00010000:1.0:1789438155.440566:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438155.440590:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff999202045c00/0x7a8dd0fcbb924c1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924c16 expref: 21 pid: 5833 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438155.440601:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff999202045c00/0x7a8dd0fcbb924c1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924c16 expref: 21 pid: 5833 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438155.440619:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff999202045c00/0x7a8dd0fcbb924c1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb924c16 expref: 21 pid: 5833 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438155.440662:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789438155.442063:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438155.445212:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438155.445241:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438155.445327:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769675648 00000100:00100000:0.0:1789438155.445335:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769675648 00010000:00010000:0.0:1789438155.445390:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff999202045600/0x7a8dd0fcbb924c7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924c78 expref: 21 pid: 5833 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438155.445421:0:5823:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789438155.445427:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1789438155.445455:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb924c2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924c24 expref: 21 pid: 5833 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438155.445468:0:5822:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789438155.445472:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749729920 00000100:00100000:0.0:1789438155.445475:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749729920 00010000:00010000:0.0:1789438155.445485:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff999202045800/0x7a8dd0fcbb924c94 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa070 expref: 10 pid: 5832 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438155.445517:0:5822:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789438155.445522:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749730048 00000100:00100000:0.0:1789438155.445525:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749730048 00010000:00010000:0.0:1789438155.445536:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991c0031a00/0x7a8dd0fcbb924c8d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa069 expref: 11 pid: 5832 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438155.445547:0:5822:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789438155.445555:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789438155.445563:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa647800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+21:3312:x1876361769675520:12345-0@lo:103: 00010000:00010000:0.0:1789438155.445697:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438155.445722:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991c2a54a00/0x7a8dd0fcbb924c39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924c32 expref: 21 pid: 5832 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.445734:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991c2a54a00/0x7a8dd0fcbb924c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924c32 expref: 21 pid: 5832 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.445749:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c2a54a00/0x7a8dd0fcbb924c39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb924c32 expref: 21 pid: 5832 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.445763:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438155.445807:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa647800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+20:3312:x1876361769675520:12345-0@lo:103: Request processed in 245us (7554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438155.445814:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789438155.445830:0:5822:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789438155.445836:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789438155.445842:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa645880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3310:x1876361769675264:12345-0@lo:103: 00010000:00010000:0.0:1789438155.445850:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438155.445854:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff999202045600/0x7a8dd0fcbb924c7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924c78 expref: 19 pid: 5833 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.445868:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff999202045600/0x7a8dd0fcbb924c7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924c78 expref: 19 pid: 5833 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.445878:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff999202045600/0x7a8dd0fcbb924c7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb924c78 expref: 19 pid: 5833 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.445887:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438155.445923:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa645880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+18:3310:x1876361769675264:12345-0@lo:103: Request processed in 81us (10599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438155.445928:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789438155.445940:0:5822:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789438155.445946:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789438155.445952:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+17:3309:x1876361769675648:12345-0@lo:103: 00010000:00010000:0.0:1789438155.445959:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438155.445963:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb924c2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924c24 expref: 17 pid: 5833 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.445970:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb924c2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924c24 expref: 17 pid: 5833 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.445980:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb924c2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb924c24 expref: 17 pid: 5833 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.445988:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438155.446014:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+16:3309:x1876361769675648:12345-0@lo:103: Request processed in 63us (3956us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438155.446020:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789438155.446030:0:5822:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789438155.446042:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:0.0:1789438155.446050:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58dec870-790c-4419-a02f-595f69c3b298+11:2354:x1876361749729920:12345-192.168.206.9@tcp:103: 00010000:00010000:0.0:1789438155.446058:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438155.446063:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff999202045800/0x7a8dd0fcbb924c94 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa070 expref: 11 pid: 5832 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.446073:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff999202045800/0x7a8dd0fcbb924c94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa070 expref: 11 pid: 5832 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.446083:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438155.446118:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58dec870-790c-4419-a02f-595f69c3b298+11:2354:x1876361749729920:12345-192.168.206.9@tcp:103: Request processed in 68us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438155.446124:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:0.0:1789438155.446226:0:5822:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789438155.446234:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 17 00000100:00100000:0.0:1789438155.446240:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58dec870-790c-4419-a02f-595f69c3b298+10:2354:x1876361749730048:12345-192.168.206.9@tcp:103: 00010000:00010000:0.0:1789438155.446248:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438155.446253:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991c0031a00/0x7a8dd0fcbb924c8d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa069 expref: 10 pid: 5832 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.446262:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991c0031a00/0x7a8dd0fcbb924c8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa069 expref: 10 pid: 5832 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.446272:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438155.446293:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58dec870-790c-4419-a02f-595f69c3b298+10:2354:x1876361749730048:12345-192.168.206.9@tcp:103: Request processed in 53us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438155.446300:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 17 00010000:00010000:0.0:1789438155.446343:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff999202045800/0x7a8dd0fcbb924c94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa070 expref: 9 pid: 5832 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438155.446360:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1876361769674112:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438155.446373:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c0031a00/0x7a8dd0fcbb924c8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa069 expref: 8 pid: 5832 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438155.446385:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1876361769674240:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438155.446426:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9991c0031e00/0x7a8dd0fcbb924ccc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438155.450003:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769675648:0@lo:103: 00000100:00100000:1.0:1789438155.450308:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa644e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7073a0da-08cf-42fe-8791-a8c6139408f2+15:3310:x1876361769675776:12345-0@lo:103: Request processed in 9754us (14843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438155.450319:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789438155.451315:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769675264:0@lo:103: 00000100:00100000:2.0:1789438155.451327:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769675776:0@lo:103: 00000100:00100000:2.0:1789438155.460156:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438155.460216:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769675904:0@lo:103: 00000100:00100000:2.0:1789438155.460265:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438155.460326:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa646680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769675520:0@lo:103: 00000100:00100000:2.0:1789438155.460333:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa647480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769676032:0@lo:103: 00000100:00100000:2.0:1789438155.460355:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438155.460380:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769675392 00000100:00100000:2.0:1789438155.460386:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769675392 00010000:00010000:2.0:1789438155.460413:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991c2a54200/0x7a8dd0fcbb924c55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924c4e expref: 15 pid: 5832 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438155.460434:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769675904 00000100:00100000:2.0:1789438155.460437:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769675904 00010000:00010000:2.0:1789438155.460451:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991c0030e00/0x7a8dd0fcbb924bf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924bec expref: 16 pid: 5832 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438155.460473:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769676032 00000100:00100000:2.0:1789438155.460476:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769676032 00010000:00010000:2.0:1789438155.460487:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff999202044400/0x7a8dd0fcbb924bc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924bc2 expref: 17 pid: 5832 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438155.460499:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789438155.460505:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d0512c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+17:3311:x1876361769675392:12345-0@lo:103: 00010000:00010000:2.0:1789438155.460518:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438155.460522:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991c2a54200/0x7a8dd0fcbb924c55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924c4e expref: 17 pid: 5832 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.460532:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991c2a54200/0x7a8dd0fcbb924c55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924c4e expref: 17 pid: 5832 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.460548:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c2a54200/0x7a8dd0fcbb924c55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb924c4e expref: 17 pid: 5832 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.460561:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789438155.460603:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d0512c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+16:3311:x1876361769675392:12345-0@lo:103: Request processed in 98us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438155.460610:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789438155.460660:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789438155.460667:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa644700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+15:3311:x1876361769675904:12345-0@lo:103: 00010000:00010000:2.0:1789438155.460674:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438155.460678:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991c0030e00/0x7a8dd0fcbb924bf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924bec expref: 15 pid: 5832 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.460686:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991c0030e00/0x7a8dd0fcbb924bf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924bec expref: 15 pid: 5832 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.460702:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c0030e00/0x7a8dd0fcbb924bf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb924bec expref: 15 pid: 5832 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.460734:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789438155.460759:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa644700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+14:3311:x1876361769675904:12345-0@lo:103: Request processed in 93us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438155.460765:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789438155.460779:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789438155.460786:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa644a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+13:3312:x1876361769676032:12345-0@lo:103: 00010000:00010000:2.0:1789438155.460793:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438155.460798:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff999202044400/0x7a8dd0fcbb924bc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924bc2 expref: 13 pid: 5832 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.460806:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff999202044400/0x7a8dd0fcbb924bc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924bc2 expref: 13 pid: 5832 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.460816:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff999202044400/0x7a8dd0fcbb924bc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb924bc2 expref: 13 pid: 5832 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.460826:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9991c0031e00/0x7a8dd0fcbb924ccc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.460834:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c0031e00/0x7a8dd0fcbb924ccc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.460848:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9991c0031e00/0x7a8dd0fcbb924ccc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.460855:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9991c0031e00/0x7a8dd0fcbb924ccc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.460867:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9991c0031e00/0x7a8dd0fcbb924ccc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.460874:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9991c0031e00/0x7a8dd0fcbb924ccc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.460880:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c0031e00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:2.0:1789438155.460884:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9991c0031e00/0x7a8dd0fcbb924ccc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.460891:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9991c0031e00/0x7a8dd0fcbb924ccc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.460903:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9991c0031e00/0x7a8dd0fcbb924ccc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.460913:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789438155.460937:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa644a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:3312:x1876361769676032:12345-0@lo:103: Request processed in 151us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438155.460943:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789438155.460971:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769675392:0@lo:103: 00000100:00100000:2.0:1789438155.460979:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769675904:0@lo:103: 00000100:00100000:2.0:1789438155.461022:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa647480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769676032:0@lo:103: 00010000:00010000:0.0:1789438155.461881:0:8433:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9991c0031e00/0x7a8dd0fcbb924ccc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.461892:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9991c0031e00/0x7a8dd0fcbb924ccc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438155.461899:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c0031e00/0x7a8dd0fcbb924ccc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438155.654181:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438156.089813:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769676544:0@lo:400: 00000100:00100000:2.0:1789438156.089880:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438156.089945:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789438156.089965:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876361769676416:0@lo:400: 00000100:00100000:2.0:1789438156.089993:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438156.090027:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769676416 00000100:00100000:2.0:1789438156.090034:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769676416 00000100:00100000:2.0:1789438156.090081:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789438156.090090:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876361769676416:12345-0@lo:400: 00000100:00100000:2.0:1789438156.090145:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876361769676416:12345-0@lo:400: Request processed in 55us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438156.090152:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789438156.090191:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876361769676416:0@lo:400: 00000100:00100000:3.0:1789438156.090317:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa647480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769676160:0@lo:400: 00000100:00100000:3.0:1789438156.090351:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438156.090381:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876361769676672:0@lo:400: 00000100:00100000:3.0:1789438156.090402:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438156.090430:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789438156.090441:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa646680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769676288:0@lo:400: 00000100:00100000:3.0:1789438156.090462:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438156.090480:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa645880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769676800:0@lo:400: 00000100:00100000:3.0:1789438156.090500:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438156.090523:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769676672 00000100:00100000:3.0:1789438156.090527:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769676672 00000100:00100000:3.0:1789438156.090552:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769676288 00000100:00100000:3.0:1789438156.090554:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769676288 00000100:00100000:3.0:1789438156.090566:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789438156.090571:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876361769676672:12345-0@lo:400: 00000100:00100000:3.0:1789438156.090604:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876361769676672:12345-0@lo:400: Request processed in 32us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438156.090610:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789438156.090633:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789438156.090639:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769676288:12345-0@lo:400: 00000100:00100000:3.0:1789438156.090676:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769676288:12345-0@lo:400: Request processed in 37us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438156.090691:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789438156.090742:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa646680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769676288:0@lo:400: 00000100:00100000:3.0:1789438156.090751:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876361769676672:0@lo:400: 00000100:00100000:0.0:1789438156.091067:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769676544 00000100:00100000:0.0:1789438156.091072:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769676544 00000100:00100000:2.0:1789438156.091165:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769676160 00000100:00100000:2.0:1789438156.091169:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769676160 00000100:00100000:2.0:1789438156.091203:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789438156.091210:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+12:3309:x1876361769676160:12345-0@lo:400: 00000100:00100000:2.0:1789438156.091245:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+12:3309:x1876361769676160:12345-0@lo:400: Request processed in 36us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438156.091250:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1789438156.091291:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789438156.091295:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789438156.091353:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa647480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769676160:0@lo:400: 00000100:00100000:0.0:1789438156.091911:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769676800 00000100:00100000:0.0:1789438156.091917:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769676800 00000100:00080000:3.0:1789438156.091979:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789438156.095125:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789438156.095145:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769676544:12345-0@lo:400: 00000100:00100000:1.0:1789438156.095308:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769676544:12345-0@lo:400: Request processed in 171us (5429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438156.095316:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789438156.095346:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789438156.095354:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769676800:12345-0@lo:400: 00000100:00100000:1.0:1789438156.095397:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769676800:12345-0@lo:400: Request processed in 44us (4896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438156.095402:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789438156.095442:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991fa645880 x1876361769676800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789438156.095455:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa645880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769676800:0@lo:400: 00010000:00080000:3.0:1789438156.096174:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991fa645180 x1876361769676544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438156.096187:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769676544:0@lo:400: 00000100:00100000:3.0:1789438156.600984:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769676928:0@lo:13: 00000100:00100000:2.0:1789438156.601019:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769677056:0@lo:13: 00000100:00100000:3.0:1789438156.601057:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438156.601099:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438156.601198:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769676928 00000100:00100000:1.0:1789438156.601206:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769676928 00000100:00100000:1.0:1789438156.601253:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769677056 00000100:00100000:1.0:1789438156.601257:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769677056 00000100:00100000:1.0:1789438156.601272:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789438156.601281:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769676928:12345-0@lo:13: 00002000:00000024:1.0:1789438156.601310:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789438156.601364:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769676928:12345-0@lo:13: Request processed in 83us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438156.601384:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789438156.601399:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789438156.601405:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769677056:12345-0@lo:13: 00002000:00000024:1.0:1789438156.601423:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789438156.601465:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769677056:12345-0@lo:13: Request processed in 60us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438156.601471:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1789438156.601607:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991f3754000 x1876361769677056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438172 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438156.601625:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769677056:0@lo:13: 00010000:00080000:3.0:1789438156.601703:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff912a00 x1876361769676928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438172 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438156.601732:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769676928:0@lo:13: 00010000:00010000:2.0:1789438156.662975:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789438157.174922:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789438157.174930:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9991ffa93000 from 39 10000000:01000000:2.0:1789438157.174951:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789438157.174993:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff999202044400/0x7a8dd0fcbb924cd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438157.175067:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff999202044400/0x7a8dd0fcbb924cd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438157.175080:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff999202044400/0x7a8dd0fcbb924cd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438157.175104:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa645500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769677184:0@lo:101: 00000100:00100000:2.0:1789438157.175170:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438157.175228:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fabaab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789438157.178244:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769677184 00000100:00100000:0.0:1789438157.178259:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769677184 00000100:00100000:0.0:1789438157.178334:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789438157.178345:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+12:5836:x1876361769677184:12345-0@lo:101: 00010000:00010000:0.0:1789438157.178361:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438157.178381:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c0031e00/0x7a8dd0fcbb924cda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924cd3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438157.178427:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c0031e00/0x7a8dd0fcbb924cda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924cd3 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438157.178438:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c0031e00/0x7a8dd0fcbb924cda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924cd3 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438157.178446:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c0031e00, rc 0) 00000100:00100000:0.0:1789438157.178537:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+13:5836:x1876361769677184:12345-0@lo:101: Request processed in 193us (3366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438157.178544:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789438157.180018:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa645500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769677184:0@lo:101: 00010000:00010000:3.0:1789438157.180046:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff999202044400/0x7a8dd0fcbb924cd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924cda expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438157.180058:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff999202044400/0x7a8dd0fcbb924cd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924cda expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438157.180132:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fabcb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769677312:0@lo:501: 00000100:00100000:3.0:1789438157.180180:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438157.180231:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991eb8e7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789438157.180395:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769677312 00000100:00100000:1.0:1789438157.180402:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769677312 00000100:00100000:1.0:1789438157.180448:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789438157.180457:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+13:5836:x1876361769677312:12345-0@lo:501: 00000100:00100000:1.0:1789438157.180772:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+13:5836:x1876361769677312:12345-0@lo:501: Request processed in 305us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438157.180779:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789438157.180992:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fabcb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769677312:0@lo:501: 00000100:00100000:3.0:1789438157.181048:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fabcb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769677440:0@lo:503: 00000100:00100000:3.0:1789438157.181088:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438157.181115:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991eb8e7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789438157.181703:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769677440 00000100:00100000:1.0:1789438157.181732:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769677440 00000100:00100000:1.0:1789438157.181761:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789438157.181768:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+13:5836:x1876361769677440:12345-0@lo:503: 00000100:00100000:1.0:1789438157.181953:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+13:5836:x1876361769677440:12345-0@lo:503: Request processed in 184us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438157.181960:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789438157.185132:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fabcb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769677440:0@lo:503: 00000100:00100000:3.0:1789438157.188877:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fabcb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8450:1876361769677568:0@lo:502: 00000100:00100000:3.0:1789438157.188976:0:8450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438157.189022:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991eb8e7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789438157.189148:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769677568 00000100:00100000:1.0:1789438157.189156:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769677568 00000100:00100000:1.0:1789438157.189204:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789438157.189213:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+13:8450:x1876361769677568:12345-0@lo:502: 00000100:00100000:1.0:1789438157.189457:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+13:8450:x1876361769677568:12345-0@lo:502: Request processed in 245us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438157.189471:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789438157.189626:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fabcb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8450:1876361769677568:0@lo:502: 00000100:00100000:3.0:1789438157.189694:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fabcb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8450:1876361769677696:0@lo:502: 00000100:00100000:3.0:1789438157.189762:0:8450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438157.189793:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991eb8e7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789438157.189849:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769677696 00000100:00100000:2.0:1789438157.189853:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769677696 00000100:00100000:2.0:1789438157.189886:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789438157.189894:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+13:8450:x1876361769677696:12345-0@lo:502: 00000100:00100000:2.0:1789438157.190058:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+13:8450:x1876361769677696:12345-0@lo:502: Request processed in 165us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438157.190065:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789438157.190267:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fabcb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8450:1876361769677696:0@lo:502: 00000040:00080000:3.0:1789438157.190286:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789438157.191139:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789438157.191162:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789438157.191172:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff999202044400/0x7a8dd0fcbb924cd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924cda expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438157.191183:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff999202044400/0x7a8dd0fcbb924cd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924cda expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789438157.191193:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789438157.191196:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1789438157.191208:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789438157.191245:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924ce1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438157.191254:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924ce1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438157.191263:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924ce1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438157.191282:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa645500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769677824:0@lo:101: 00000100:00100000:2.0:1789438157.191323:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438157.191356:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fabaa9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789438157.191592:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769677824 00000100:00100000:0.0:1789438157.191598:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769677824 00000100:00100000:0.0:1789438157.191629:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789438157.191656:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+13:5836:x1876361769677824:12345-0@lo:101: 00010000:00010000:0.0:1789438157.191666:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438157.191679:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c0031a00/0x7a8dd0fcbb924ce8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924ce1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438157.191700:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c0031a00/0x7a8dd0fcbb924ce8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924ce1 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438157.191743:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c0031a00/0x7a8dd0fcbb924ce8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924ce1 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438157.191751:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c0031a00, rc 0) 00000100:00100000:0.0:1789438157.191794:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+14:5836:x1876361769677824:12345-0@lo:101: Request processed in 158us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438157.191800:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789438157.191885:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa645500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769677824:0@lo:101: 00010000:00010000:2.0:1789438157.191900:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924ce1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924ce8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438157.191908:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924ce1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924ce8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438157.191946:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa645500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769677952:0@lo:501: 00000100:00100000:2.0:1789438157.191978:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438157.192000:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fabaa9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438157.192127:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769677952 00000100:00100000:3.0:1789438157.192132:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769677952 00000100:00100000:3.0:1789438157.192151:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789438157.192158:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+14:5836:x1876361769677952:12345-0@lo:501: 00000100:00100000:3.0:1789438157.192375:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+14:5836:x1876361769677952:12345-0@lo:501: Request processed in 217us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438157.192382:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789438157.192440:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa645500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769677952:0@lo:501: 00000100:00100000:2.0:1789438157.192464:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa645500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769678080:0@lo:503: 00000100:00100000:2.0:1789438157.192508:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438157.192529:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fabaa9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789438157.193698:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769678080 00000100:00100000:0.0:1789438157.193842:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769678080 00000100:00100000:0.0:1789438157.193881:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789438157.193889:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+14:5836:x1876361769678080:12345-0@lo:503: 00000100:00100000:0.0:1789438157.194663:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+14:5836:x1876361769678080:12345-0@lo:503: Request processed in 773us (2153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438157.194671:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789438157.195270:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa645500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769678080:0@lo:503: 00000100:00100000:2.0:1789438157.198207:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa645500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8451:1876361769678208:0@lo:502: 00000100:00100000:2.0:1789438157.198297:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438157.198343:0:8451:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fabaa780 going to sleep for 11 seconds 00000100:00100000:0.0:1789438157.198580:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769678208 00000100:00100000:0.0:1789438157.198586:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769678208 00000100:00100000:0.0:1789438157.198645:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789438157.198653:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+14:8451:x1876361769678208:12345-0@lo:502: 00000100:00100000:0.0:1789438157.198910:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+14:8451:x1876361769678208:12345-0@lo:502: Request processed in 257us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438157.198917:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789438157.199760:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa645500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8451:1876361769678208:0@lo:502: 00000020:01000000:2.0:1789438157.199792:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789438157.199815:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789438157.199818:0:8451:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789438157.199825:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789438157.199853:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa645500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8451:1876361769678336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789438157.199897:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438157.199927:0:8451:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fabaa780 going to sleep for 11 seconds 00000100:00100000:1.0:1789438157.200089:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769678336 00000100:00100000:1.0:1789438157.200095:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769678336 00000100:00100000:1.0:1789438157.200135:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789438157.200143:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+14:8451:x1876361769678336:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789438157.200316:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+14:8451:x1876361769678336:12345-0@lo:502:llog_process_th.0 Request processed in 173us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438157.200323:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789438157.202547:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa645500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8451:1876361769678336:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789438157.202594:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789438157.202604:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789438157.202606:0:8451:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789438157.202611:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1789438157.203592:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1789438157.203616:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789438157.203626:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924ce1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924ce8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438157.203661:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924ce1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924ce8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789438157.203673:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789438157.203675:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9991d08f6800 from 39 10000000:01000000:1.0:1789438157.203678:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789438157.203762:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9db000/0x7a8dd0fcbb924cef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438157.203771:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991ff9db000/0x7a8dd0fcbb924cef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438157.203781:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991ff9db000/0x7a8dd0fcbb924cef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438157.203812:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3756a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769678464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789438157.203885:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438157.203920:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f3f74600 going to sleep for 11 seconds 00000100:00100000:0.0:1789438157.204105:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769678464 00000100:00100000:0.0:1789438157.204113:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769678464 00000100:00100000:0.0:1789438157.204156:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789438157.204164:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+14:5836:x1876361769678464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789438157.204176:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438157.204189:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c0030600/0x7a8dd0fcbb924cf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924cef expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438157.204211:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c0030600/0x7a8dd0fcbb924cf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924cef expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438157.204222:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c0030600/0x7a8dd0fcbb924cf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924cef expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438157.204230:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c0030600, rc 0) 00000100:00100000:0.0:1789438157.204294:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+15:5836:x1876361769678464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438157.204300:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789438157.205342:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3756a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769678464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789438157.205361:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991ff9db000/0x7a8dd0fcbb924cef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924cf6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438157.205370:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991ff9db000/0x7a8dd0fcbb924cef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924cf6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438157.205431:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3756a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769678592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789438157.205467:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438157.205502:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f3f74600 going to sleep for 11 seconds 00000100:00100000:2.0:1789438157.205909:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769678592 00000100:00100000:2.0:1789438157.205915:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769678592 00000100:00100000:2.0:1789438157.205963:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789438157.205972:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+15:5836:x1876361769678592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789438157.206220:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+15:5836:x1876361769678592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438157.206227:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789438157.207383:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3756a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769678592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789438157.207430:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3756a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769678720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789438157.207484:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438157.207510:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f3f74600 going to sleep for 11 seconds 00000100:00100000:0.0:1789438157.207757:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769678720 00000100:00100000:0.0:1789438157.207765:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769678720 00000100:00100000:0.0:1789438157.207811:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789438157.207820:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+15:5836:x1876361769678720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789438157.208415:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+15:5836:x1876361769678720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 595us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438157.208423:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789438157.208933:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3756a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769678720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789438157.209371:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff913100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8452:1876361769678848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789438157.209416:0:8452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438157.209482:0:8452:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c6d5d000 going to sleep for 11 seconds 00000100:00100000:2.0:1789438157.209584:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769678848 00000100:00100000:2.0:1789438157.209590:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769678848 00000100:00100000:2.0:1789438157.209842:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789438157.209852:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+15:8452:x1876361769678848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789438157.210060:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+15:8452:x1876361769678848:12345-0@lo:502:llog_process_th.0 Request processed in 210us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438157.210067:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789438157.210141:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff913100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8452:1876361769678848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789438157.210191:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3754a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8452:1876361769678976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789438157.210222:0:8452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438157.211213:0:8452:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f3f74600 going to sleep for 11 seconds 00000100:00100000:0.0:1789438157.211340:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769678976 00000100:00100000:0.0:1789438157.211348:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769678976 00000100:00100000:0.0:1789438157.211384:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789438157.211391:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+15:8452:x1876361769678976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789438157.211609:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+15:8452:x1876361769678976:12345-0@lo:502:llog_process_th.0 Request processed in 218us (1385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438157.211616:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789438157.211918:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3754a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8452:1876361769678976:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789438157.211945:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789438157.212107:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789438157.212129:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789438157.214010:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9db000/0x7a8dd0fcbb924cef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924cf6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438157.214030:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991ff9db000/0x7a8dd0fcbb924cef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924cf6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789438157.214059:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789438157.214062:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1789438157.214065:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789438157.214099:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c0030000/0x7a8dd0fcbb924cfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438157.214106:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991c0030000/0x7a8dd0fcbb924cfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438157.214117:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991c0030000/0x7a8dd0fcbb924cfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438157.214139:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff911500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769679104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789438157.214199:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438157.214247:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c6d5d900 going to sleep for 11 seconds 00000100:00100000:0.0:1789438157.214267:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769679104 00000100:00100000:0.0:1789438157.214274:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769679104 00000100:00100000:0.0:1789438157.214309:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789438157.214317:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+15:5836:x1876361769679104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789438157.214327:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438157.214340:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c0030800/0x7a8dd0fcbb924d04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924cfd expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438157.214361:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c0030800/0x7a8dd0fcbb924d04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924cfd expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438157.214371:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c0030800/0x7a8dd0fcbb924d04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924cfd expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438157.214389:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c0030800, rc 0) 00000100:00100000:0.0:1789438157.214425:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+16:5836:x1876361769679104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438157.214432:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789438157.214469:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff911500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769679104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789438157.214482:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991c0030000/0x7a8dd0fcbb924cfd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924d04 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438157.214490:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991c0030000/0x7a8dd0fcbb924cfd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924d04 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438157.214536:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff911500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769679232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789438157.214561:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438157.214573:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c6d5d900 going to sleep for 11 seconds 00000100:00100000:0.0:1789438157.214584:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769679232 00000100:00100000:0.0:1789438157.214588:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769679232 00000100:00100000:0.0:1789438157.214605:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789438157.214611:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+16:5836:x1876361769679232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789438157.215290:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+16:5836:x1876361769679232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 677us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438157.215296:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789438157.217078:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff911500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769679232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789438157.217139:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa645500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769679360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789438157.217214:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438157.217271:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fabaa600 going to sleep for 11 seconds 00000100:00100000:0.0:1789438157.220063:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769679360 00000100:00100000:0.0:1789438157.220076:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769679360 00000100:00100000:0.0:1789438157.220144:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789438157.220154:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+16:5836:x1876361769679360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789438157.220392:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+16:5836:x1876361769679360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 239us (3177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438157.220400:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789438157.220507:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa645500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769679360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789438157.221246:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa645500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8453:1876361769679488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789438157.221293:0:8453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438157.221329:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fabaa840 going to sleep for 11 seconds 00000100:00100000:0.0:1789438157.221421:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769679488 00000100:00100000:0.0:1789438157.221425:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769679488 00000100:00100000:0.0:1789438157.221456:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789438157.221462:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+16:8453:x1876361769679488:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789438157.221612:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+16:8453:x1876361769679488:12345-0@lo:502:llog_process_th.0 Request processed in 150us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438157.221620:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789438157.223601:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa645500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8453:1876361769679488:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789438157.223657:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789438157.223676:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438157.223679:0:8453:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789438157.223685:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789438157.223737:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3754a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8453:1876361769679616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789438157.223793:0:8453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438157.224025:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f3f74600 going to sleep for 11 seconds 00000100:00100000:2.0:1789438157.224171:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769679616 00000100:00100000:2.0:1789438157.224177:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769679616 00000100:00100000:2.0:1789438157.224209:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789438157.224218:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+16:8453:x1876361769679616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789438157.224495:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+16:8453:x1876361769679616:12345-0@lo:502:llog_process_th.0 Request processed in 278us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438157.224503:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789438157.224605:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3754a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8453:1876361769679616:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789438157.224626:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789438157.224630:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438157.224632:0:8453:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789438157.224989:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1789438157.225143:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1789438157.225163:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789438157.225173:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c0030000/0x7a8dd0fcbb924cfd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924d04 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438157.225184:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991c0030000/0x7a8dd0fcbb924cfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924d04 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789438157.225193:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789438157.225196:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9991d197a000 from 39 10000000:01000000:0.0:1789438157.225198:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789438157.225224:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c0031200/0x7a8dd0fcbb924d0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438157.225231:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991c0031200/0x7a8dd0fcbb924d0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438157.225252:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991c0031200/0x7a8dd0fcbb924d0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438157.225279:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff912300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769679744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789438157.225314:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438157.225352:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c6d5d900 going to sleep for 11 seconds 00000100:00100000:1.0:1789438157.225493:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769679744 00000100:00100000:1.0:1789438157.225498:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769679744 00000100:00100000:1.0:1789438157.225533:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789438157.225540:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+16:5836:x1876361769679744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789438157.225550:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438157.225562:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991ff9db800/0x7a8dd0fcbb924d12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924d0b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438157.225582:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991ff9db800/0x7a8dd0fcbb924d12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924d0b expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438157.225592:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991ff9db800/0x7a8dd0fcbb924d12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924d0b expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438157.225599:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9db800, rc 0) 00000100:00100000:1.0:1789438157.225632:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+17:5836:x1876361769679744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438157.225661:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789438157.225935:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff912300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769679744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789438157.225948:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991c0031200/0x7a8dd0fcbb924d0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924d12 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438157.225957:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991c0031200/0x7a8dd0fcbb924d0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924d12 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438157.226002:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff912300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769679872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789438157.226028:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438157.226049:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c6d5d900 going to sleep for 11 seconds 00000100:00100000:1.0:1789438157.226109:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769679872 00000100:00100000:1.0:1789438157.226114:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769679872 00000100:00100000:1.0:1789438157.226134:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789438157.226140:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+17:5836:x1876361769679872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789438157.226366:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+17:5836:x1876361769679872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438157.226373:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789438157.226562:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff912300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769679872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789438157.226588:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff912300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769680000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789438157.226626:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438157.226667:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c6d5d900 going to sleep for 11 seconds 00000100:00100000:1.0:1789438157.227111:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769680000 00000100:00100000:1.0:1789438157.227116:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769680000 00000100:00100000:1.0:1789438157.227146:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789438157.227153:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+17:5836:x1876361769680000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789438157.227301:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+17:5836:x1876361769680000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438157.227308:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789438157.227455:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff912300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769680000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789438157.228207:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff912300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8454:1876361769680128:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789438157.228324:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438157.228361:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c83a69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789438157.228401:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769680128 00000100:00100000:2.0:1789438157.228406:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769680128 00000100:00100000:2.0:1789438157.228473:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789438157.228483:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+17:8454:x1876361769680128:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789438157.228692:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+17:8454:x1876361769680128:12345-0@lo:502:llog_process_th.0 Request processed in 211us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438157.228729:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789438157.228833:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff912300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8454:1876361769680128:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789438157.228876:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff912300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8454:1876361769680256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789438157.228912:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438157.229326:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c83a69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789438157.229444:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769680256 00000100:00100000:1.0:1789438157.229450:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769680256 00000100:00100000:1.0:1789438157.229478:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789438157.229485:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+17:8454:x1876361769680256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789438157.229876:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+17:8454:x1876361769680256:12345-0@lo:502:llog_process_th.0 Request processed in 391us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438157.229883:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789438157.230009:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff912300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8454:1876361769680256:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789438157.230034:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789438157.230345:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789438157.230361:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789438157.230371:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c0031200/0x7a8dd0fcbb924d0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924d12 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438157.230381:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991c0031200/0x7a8dd0fcbb924d0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924d12 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789438157.230398:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789438157.230400:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1789438157.230403:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789438157.230428:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9da400/0x7a8dd0fcbb924d19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438157.230436:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991ff9da400/0x7a8dd0fcbb924d19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438157.230444:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991ff9da400/0x7a8dd0fcbb924d19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438157.230462:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3754a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769680384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789438157.230492:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438157.230522:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e7550540 going to sleep for 11 seconds 00000100:00100000:2.0:1789438157.230563:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769680384 00000100:00100000:2.0:1789438157.230568:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769680384 00000100:00100000:2.0:1789438157.230601:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789438157.230608:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+17:5836:x1876361769680384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789438157.230617:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438157.230628:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff999202045c00/0x7a8dd0fcbb924d20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924d19 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438157.231002:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff999202045c00/0x7a8dd0fcbb924d20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924d19 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438157.231012:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff999202045c00/0x7a8dd0fcbb924d20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924d19 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438157.231020:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999202045c00, rc 0) 00000100:00100000:2.0:1789438157.231106:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769680384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 498us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438157.231112:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789438157.231307:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3754a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769680384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789438157.231320:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991ff9da400/0x7a8dd0fcbb924d19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924d20 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438157.231329:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991ff9da400/0x7a8dd0fcbb924d19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924d20 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438157.231375:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3754a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769680512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789438157.231400:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438157.231461:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e7550540 going to sleep for 11 seconds 00000100:00100000:0.0:1789438157.231491:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769680512 00000100:00100000:0.0:1789438157.231496:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769680512 00000100:00100000:0.0:1789438157.231558:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789438157.231566:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769680512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789438157.232214:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769680512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 647us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438157.232221:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789438157.232334:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3754a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769680512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789438157.232379:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3754a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769680640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789438157.232423:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438157.233067:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e7550540 going to sleep for 11 seconds 00000100:00100000:0.0:1789438157.233544:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769680640 00000100:00100000:0.0:1789438157.233551:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769680640 00000100:00100000:0.0:1789438157.233593:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789438157.233601:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769680640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789438157.233848:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769680640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 247us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438157.233856:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789438157.235650:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3754a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769680640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789438157.238586:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff912300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8455:1876361769680768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789438157.238684:0:8455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438157.238755:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c6d5d900 going to sleep for 11 seconds 00000100:00100000:1.0:1789438157.238829:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769680768 00000100:00100000:1.0:1789438157.238836:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769680768 00000100:00100000:1.0:1789438157.238872:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789438157.238881:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+18:8455:x1876361769680768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789438157.239129:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+18:8455:x1876361769680768:12345-0@lo:502:llog_process_th.0 Request processed in 248us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438157.239136:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789438157.239395:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff912300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8455:1876361769680768:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789438157.239423:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789438157.239432:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789438157.239434:0:8455:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789438157.239448:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789438157.239473:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff912300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8455:1876361769680896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789438157.239508:0:8455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438157.239530:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fa9ea780 going to sleep for 11 seconds 00000100:00100000:1.0:1789438157.240293:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769680896 00000100:00100000:1.0:1789438157.240300:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769680896 00000100:00100000:1.0:1789438157.240333:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789438157.240342:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+18:8455:x1876361769680896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789438157.240537:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+18:8455:x1876361769680896:12345-0@lo:502:llog_process_th.0 Request processed in 196us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438157.240544:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789438157.242531:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff912300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8455:1876361769680896:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789438157.242574:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789438157.242583:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789438157.242585:0:8455:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789438157.242590:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1789438157.242813:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1789438157.242831:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789438157.242842:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9da400/0x7a8dd0fcbb924d19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924d20 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438157.242852:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991ff9da400/0x7a8dd0fcbb924d19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924d20 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789438157.242861:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789438157.242864:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9991e1e54d40 from 1 10000000:01000000:1.0:1789438157.242877:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789438157.242908:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9da800/0x7a8dd0fcbb924d27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438157.242916:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991ff9da800/0x7a8dd0fcbb924d27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438157.242926:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991ff9da800/0x7a8dd0fcbb924d27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438157.242947:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3754a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769681024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789438157.243001:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438157.243044:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e7550300 going to sleep for 11 seconds 00000100:00100000:0.0:1789438157.243129:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769681024 00000100:00100000:0.0:1789438157.243136:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769681024 00000100:00100000:0.0:1789438157.243171:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789438157.243179:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769681024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789438157.243190:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438157.243205:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c0030e00/0x7a8dd0fcbb924d2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924d27 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438157.243226:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c0030e00/0x7a8dd0fcbb924d2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924d27 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438157.243247:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c0030e00/0x7a8dd0fcbb924d2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924d27 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438157.243257:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c0030e00, rc 0) 00000100:00100000:0.0:1789438157.243301:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:5836:x1876361769681024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438157.243307:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789438157.244208:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3754a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769681024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789438157.244225:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991ff9da800/0x7a8dd0fcbb924d27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924d2e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438157.244246:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991ff9da800/0x7a8dd0fcbb924d27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924d2e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438157.244303:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3754a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769681152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789438157.244339:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438157.244361:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e7550300 going to sleep for 11 seconds 00000100:00100000:0.0:1789438157.244481:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769681152 00000100:00100000:0.0:1789438157.244487:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769681152 00000100:00100000:0.0:1789438157.244522:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789438157.244528:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:5836:x1876361769681152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789438157.244782:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:5836:x1876361769681152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (442us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789438157.244789:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789438157.245166:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3754a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769681152:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1789438157.245188:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789438157.245197:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9da800/0x7a8dd0fcbb924d27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924d2e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438157.245216:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991ff9da800/0x7a8dd0fcbb924d27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924d2e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438157.689954:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438158.711260:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438159.735313:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438160.351395:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438160.351459:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438160.351501:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438160.351539:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438160.351679:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749730304 00000100:00100000:0.0:1789438160.351689:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749730304 00000100:00100000:0.0:1789438160.352918:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 31 00000100:00100000:0.0:1789438160.352936:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+6:2356:x1876361749730304:12345-192.168.206.9@tcp:400: 00000100:00100000:0.0:1789438160.353018:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+6:2356:x1876361749730304:12345-192.168.206.9@tcp:400: Request processed in 89us (1632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438160.353025:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 31 00000100:00100000:2.0:1789438160.353446:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749730176 00000100:00100000:2.0:1789438160.353454:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749730176 00000100:00100000:2.0:1789438160.353496:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 164 00000100:00100000:2.0:1789438160.353504:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+8:2356:x1876361749730176:12345-192.168.206.9@tcp:400: 00000100:00100000:2.0:1789438160.353542:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+8:2356:x1876361749730176:12345-192.168.206.9@tcp:400: Request processed in 38us (2040us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438160.353562:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 164 00000100:00100000:2.0:1789438160.353608:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749730560 00000100:00100000:2.0:1789438160.353612:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749730560 00000100:00100000:2.0:1789438160.353649:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749730432 00000100:00100000:2.0:1789438160.353652:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749730432 00000100:00100000:2.0:1789438160.353669:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:2.0:1789438160.353680:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1274be99-2d57-4dac-a13e-a89426512ee0+5:2356:x1876361749730560:12345-192.168.206.9@tcp:400: 00000100:00100000:2.0:1789438160.353731:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1274be99-2d57-4dac-a13e-a89426512ee0+5:2356:x1876361749730560:12345-192.168.206.9@tcp:400: Request processed in 28us (2248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438160.353738:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:2.0:1789438160.353750:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:2.0:1789438160.353756:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1274be99-2d57-4dac-a13e-a89426512ee0+5:2356:x1876361749730432:12345-192.168.206.9@tcp:400: 00000100:00100000:2.0:1789438160.353779:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1274be99-2d57-4dac-a13e-a89426512ee0+5:2356:x1876361749730432:12345-192.168.206.9@tcp:400: Request processed in 24us (2240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438160.353784:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00080000:3.0:1789438160.353951:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789438160.353955:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789438160.353958:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789438160.759376:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438160.857044:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438160.863955:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749730688 00000100:00100000:1.0:1789438160.863972:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749730688 00000100:00100000:1.0:1789438160.864142:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 165 00000100:00100000:1.0:1789438160.864154:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+8:5595:x1876361749730688:12345-192.168.206.9@tcp:101: 00010000:00010000:1.0:1789438160.864175:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438160.864197:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991ff9daa00/0x7a8dd0fcbb924d35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x483b483084eaa0d2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438160.864227:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991ff9daa00/0x7a8dd0fcbb924d35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0d2 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438160.864238:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991ff9daa00/0x7a8dd0fcbb924d35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0d2 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438160.864247:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9daa00, rc 0) 00000100:00100000:1.0:1789438160.864319:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+9:5595:x1876361749730688:12345-192.168.206.9@tcp:101: Request processed in 167us (7283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438160.864326:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 165 00000100:00100000:2.0:1789438160.868659:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438160.868756:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749730816 00000100:00100000:0.0:1789438160.868767:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749730816 00000100:00100000:0.0:1789438160.868827:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 166 00000100:00100000:0.0:1789438160.868837:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+9:5595:x1876361749730816:12345-192.168.206.9@tcp:501: 00000100:00100000:0.0:1789438160.869527:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+9:5595:x1876361749730816:12345-192.168.206.9@tcp:501: Request processed in 687us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438160.869537:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 166 00000100:00100000:0.0:1789438160.875137:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438160.876093:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749730944 00000100:00100000:1.0:1789438160.876109:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749730944 00000100:00100000:1.0:1789438160.876183:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 167 00000100:00100000:1.0:1789438160.876197:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+9:5595:x1876361749730944:12345-192.168.206.9@tcp:503: 00000100:00100000:1.0:1789438160.877576:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+9:5595:x1876361749730944:12345-192.168.206.9@tcp:503: Request processed in 1373us (2440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438160.877601:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 167 00000100:00100000:3.0:1789438160.888753:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438160.890499:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749731072 00000100:00100000:2.0:1789438160.890511:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749731072 00000100:00100000:2.0:1789438160.890570:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 168 00000100:00100000:2.0:1789438160.890579:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+9:6085:x1876361749731072:12345-192.168.206.9@tcp:502: 00000100:00100000:2.0:1789438160.890973:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+9:6085:x1876361749731072:12345-192.168.206.9@tcp:502: Request processed in 393us (2228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438160.890982:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 168 00000100:00100000:2.0:1789438160.900155:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438160.900378:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749731200 00000100:00100000:1.0:1789438160.900389:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749731200 00000100:00100000:1.0:1789438160.900437:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 169 00000100:00100000:1.0:1789438160.900446:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+9:6085:x1876361749731200:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789438160.900747:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+9:6085:x1876361749731200:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 301us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438160.900755:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 169 00000100:00100000:1.0:1789438160.906919:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438160.907056:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749731328 00000100:00100000:0.0:1789438160.907067:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749731328 00000100:00100000:0.0:1789438160.907116:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 170 00000100:00100000:0.0:1789438160.907134:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+9:5595:x1876361749731328:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789438160.907149:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438160.907175:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c0030200/0x7a8dd0fcbb924d3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x483b483084eaa0d9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438160.907216:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c0030200/0x7a8dd0fcbb924d3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0d9 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438160.907228:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c0030200/0x7a8dd0fcbb924d3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0d9 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438160.907238:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c0030200, rc 0) 00000100:00100000:0.0:1789438160.907291:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+10:5595:x1876361749731328:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 Request processed in 167us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438160.907298:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 170 00000100:00100000:3.0:1789438160.910990:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438160.911248:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749731456 00000100:00100000:2.0:1789438160.911259:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749731456 00000100:00100000:2.0:1789438160.911314:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 171 00000100:00100000:2.0:1789438160.911324:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+10:5595:x1876361749731456:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789438160.911611:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+10:5595:x1876361749731456:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 Request processed in 287us (629us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789438160.911632:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 171 00000100:00100000:0.0:1789438161.207107:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876361769681408:0@lo:400:kworker.0 00000100:00100000:3.0:1789438161.207176:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769681280:0@lo:400:kworker.0 00000100:00100000:0.0:1789438161.207176:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438161.207245:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769681536:0@lo:400:kworker.0 00000100:00100000:1.0:1789438161.209340:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769681408 00000100:00100000:1.0:1789438161.209353:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769681408 00000100:00100000:1.0:1789438161.209437:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789438161.209448:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876361769681408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438161.211343:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438161.212215:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876361769681792:0@lo:400:kworker.0 00000100:00100000:3.0:1789438161.212266:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438161.212334:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769681664:0@lo:400:kworker.0 00000100:00100000:3.0:1789438161.212358:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438161.212386:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769681664 00000100:00100000:3.0:1789438161.212392:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769681664 00000100:00100000:3.0:1789438161.212565:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789438161.212575:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769681664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438161.212634:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769681664:12345-0@lo:400:kworker.0 Request processed in 61us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438161.212640:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1789438161.212662:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789438161.212683:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991f3754000 x1876361769681664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438161.212696:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769681664:0@lo:400:kworker.0 00000100:00100000:3.0:1789438161.212742:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769681792 00000100:00100000:3.0:1789438161.212746:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769681792 00000100:00100000:3.0:1789438161.212770:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789438161.212776:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876361769681792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438161.212821:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876361769681792:12345-0@lo:400:kworker.0 Request processed in 45us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438161.212828:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1789438161.212841:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789438161.212855:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876361769681792:0@lo:400:kworker.0 00000100:00100000:3.0:1789438161.212890:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769681280 00000100:00100000:3.0:1789438161.212894:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769681280 00000100:00100000:3.0:1789438161.212917:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789438161.212923:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3309:x1876361769681280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438161.212953:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3309:x1876361769681280:12345-0@lo:400:kworker.0 Request processed in 31us (1616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438161.212959:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789438161.212985:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769681280:0@lo:400:kworker.0 00000100:00100000:2.0:1789438161.213633:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438161.214231:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769681536 00000100:00100000:3.0:1789438161.214239:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769681536 00000100:00100000:3.0:1789438161.214289:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789438161.214296:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769681536:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789438161.214314:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789438161.214350:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769681536:12345-0@lo:400:kworker.0 Request processed in 54us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438161.214357:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789438161.214398:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769681536:0@lo:400:kworker.0 00000100:00100000:0.0:1789438161.219668:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff989180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769681920:0@lo:400:kworker.0 00000100:00100000:0.0:1789438161.219767:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438161.220072:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876361769681408:12345-0@lo:400:kworker.0 Request processed in 10624us (12895us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438161.220084:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789438161.220191:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876361769681408:0@lo:400:kworker.0 00000100:00100000:2.0:1789438161.220327:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769681920 00000100:00100000:2.0:1789438161.220335:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769681920 00000100:00100000:2.0:1789438161.220554:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789438161.220564:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769681920:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789438161.220607:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789438161.220640:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769681920:12345-0@lo:400:kworker.0 Request processed in 77us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438161.220647:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1789438161.220751:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff989180 x1876361769681920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789438161.220762:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff989180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769681920:0@lo:400:kworker.0 00000100:00100000:0.0:1789438161.720886:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff989180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769682048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789438161.720954:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438161.721697:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769682048 00000100:00100000:2.0:1789438161.721735:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769682048 00000100:00100000:2.0:1789438161.721789:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789438161.721798:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769682048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789438161.721833:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789438161.722033:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769682048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 236us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438161.722041:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789438161.722100:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff989180 x1876361769682048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438161.722121:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff989180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769682048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789438161.723749:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769682176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789438161.723810:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438161.725152:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769682176 00000100:00100000:0.0:1789438161.725164:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769682176 00000100:00100000:0.0:1789438161.725225:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789438161.725236:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769682176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789438161.725267:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438161.725329:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769682176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (1517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438161.725365:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789438161.725522:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff913b80 x1876361769682176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789438161.725542:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769682176:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789438161.791478:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789438162.172962:0:8495:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5ca8e7d0 20000000:00000080:3.0:1789438162.172979:0:8495:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9991f3d6c000 uarg=0000000000000000 20000000:01000000:3.0:1789438162.173020:0:8495:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789438162.173026:0:8495:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789438162.173030:0:8495:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789438162.178424:0:8496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1789438162.178652:0:8495:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1789438162.193876:0:8495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1789438162.193971:0:8495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1789438162.194044:0:8495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1789438162.194068:0:8495:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789438162.194092:0:8495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924d43 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.194110:0:8495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991c2a54800/0x7a8dd0fcbb924ab8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924ab1 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.194119:0:8495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991c2a55400/0x7a8dd0fcbb924b1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924b13 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.194127:0:8495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991c2a54600/0x7a8dd0fcbb924be5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924bde expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.194138:0:8495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff999202045a00/0x7a8dd0fcbb924ca2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0a1 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.195313:0:8495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924d43 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.196465:0:8495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff999202045a00/0x7a8dd0fcbb924ca2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0a1 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.196481:0:8495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff999202045a00/0x7a8dd0fcbb924ca2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0a1 expref: 9 pid: 5832 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438162.196496:0:8495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff911c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8495:1876361769682304:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438162.196634:0:8495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991c2a54600/0x7a8dd0fcbb924be5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb924bde expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.196644:0:8495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9991c2a54600/0x7a8dd0fcbb924be5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924bde expref: 18 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438162.196656:0:8495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff910a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8495:1876361769682432:0@lo:104: 00000100:00100000:0.0:1789438162.196701:0:8495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789438162.196766:0:8495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991c2a55400/0x7a8dd0fcbb924b1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb924b13 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.196776:0:8495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9991c2a55400/0x7a8dd0fcbb924b1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b13 expref: 18 pid: 5832 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438162.196784:0:8495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff912680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8495:1876361769682560:0@lo:104: 00000100:00100000:0.0:1789438162.196824:0:8495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789438162.196852:0:8495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991c2a54800/0x7a8dd0fcbb924ab8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb924ab1 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.196861:0:8495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9991c2a54800/0x7a8dd0fcbb924ab8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924ab1 expref: 18 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438162.196869:0:8495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff911f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8495:1876361769682688:0@lo:104: 00000100:00100000:0.0:1789438162.196885:0:8495:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fa9ea0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438162.197156:0:6695:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789438162.197234:0:6695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438162.197260:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769682432 00000100:00100000:3.0:1789438162.197266:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769682432 00000100:00100000:3.0:1789438162.197302:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769682560 00000100:00100000:3.0:1789438162.197304:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769682560 00000100:00100000:3.0:1789438162.197313:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769682688 00000100:00100000:3.0:1789438162.197315:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769682688 00000100:00100000:3.0:1789438162.197328:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789438162.197336:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff911180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7073a0da-08cf-42fe-8791-a8c6139408f2+5:8495:x1876361769682432:12345-0@lo:104: 00010000:00010000:3.0:1789438162.197349:0:6695:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9991ff9da600/0x7a8dd0fcbb924bde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924be5 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438162.197377:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789438162.197389:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f41d6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+5:8495:x1876361769682560:12345-0@lo:104: 00010000:00010000:3.0:1789438162.197397:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1789438162.197401:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9991e0966800/0x7a8dd0fcbb924b13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924b1a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438162.197404:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff911180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7073a0da-08cf-42fe-8791-a8c6139408f2+5:8495:x1876361769682432:12345-0@lo:104: Request processed in 67us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438162.197418:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789438162.197438:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789438162.197447:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7073a0da-08cf-42fe-8791-a8c6139408f2+4:8495:x1876361769682688:12345-0@lo:104: 00010000:00010000:3.0:1789438162.197455:0:6695:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9991c0031600/0x7a8dd0fcbb924ab1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924ab8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438162.197581:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789438162.197587:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f41d6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+4:8495:x1876361769682560:12345-0@lo:104: Request processed in 202us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438162.197593:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789438162.199469:0:8495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff910a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8495:1876361769682432:0@lo:104: 00000100:00100000:0.0:1789438162.199483:0:8495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff912680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8495:1876361769682560:0@lo:104: 00000100:00100000:0.0:1789438162.199492:0:8495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff911f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8495:1876361769682688:0@lo:104: 00010000:00010000:3.0:1789438162.201391:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789438162.201407:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7073a0da-08cf-42fe-8791-a8c6139408f2+3:8495:x1876361769682688:12345-0@lo:104: Request processed in 3959us (4169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438162.201418:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789438162.201594:0:8495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff911c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8495:1876361769682304:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789438162.201610:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00010000:00010000:3.0:1789438162.201655:0:8495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924d43 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438162.201766:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789438162.201773:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991ff9da600/0x7a8dd0fcbb924bde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924be5 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438162.201782:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9da600 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:3.0:1789438162.201786:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991ff9da600/0x7a8dd0fcbb924bde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb924be5 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438162.201795:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991ff9da600/0x7a8dd0fcbb924bde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb924be5 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789438162.201802:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991ff9da600/0x7a8dd0fcbb924bde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb924be5 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789438162.201808:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789438162.201862:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991ff9da600/0x7a8dd0fcbb924bde lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924be5 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438162.201868:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789438162.201893:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991ff9da600/0x7a8dd0fcbb924bde lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924be5 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438162.201901:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991ff9da600/0x7a8dd0fcbb924bde lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924be5 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438162.201915:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749731584 00010000:00010000:3.0:1789438162.201916:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789438162.201920:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991e0966800/0x7a8dd0fcbb924b13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924b1a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438162.201930:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749731584 00010000:00010000:3.0:1789438162.201936:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0966800 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:3.0:1789438162.201940:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991e0966800/0x7a8dd0fcbb924b13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb924b1a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438162.201946:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991e0966800/0x7a8dd0fcbb924b13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb924b1a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789438162.201951:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991e0966800/0x7a8dd0fcbb924b13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb924b1a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789438162.201954:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789438162.201964:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff999202045a00/0x7a8dd0fcbb924ca2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0a1 expref: 10 pid: 5832 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438162.201970:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991e0966800/0x7a8dd0fcbb924b13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924b1a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438162.201976:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789438162.201985:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991e0966800/0x7a8dd0fcbb924b13 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924b1a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438162.201989:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991e0966800/0x7a8dd0fcbb924b13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924b1a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438162.201999:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789438162.202000:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 21 00010000:00010000:3.0:1789438162.202004:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991c0031600/0x7a8dd0fcbb924ab1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924ab8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438162.202012:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c0031600 already unused, calling callback (ffffffffc1b57c20) 00000100:00100000:1.0:1789438162.202016:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff910700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58dec870-790c-4419-a02f-595f69c3b298+10:2353:x1876361749731584:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789438162.202042:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438162.202049:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff999202045a00/0x7a8dd0fcbb924ca2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0a1 expref: 10 pid: 5832 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438162.202061:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff999202045a00/0x7a8dd0fcbb924ca2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0a1 expref: 10 pid: 5832 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438162.202076:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff999202045a00/0x7a8dd0fcbb924ca2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0a1 expref: 10 pid: 5832 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438162.202088:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:00010000:3.0:1789438162.202095:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991c0031600/0x7a8dd0fcbb924ab1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb924ab8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438162.202114:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991c0031600/0x7a8dd0fcbb924ab1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb924ab8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789438162.202121:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991c0031600/0x7a8dd0fcbb924ab1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb924ab8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789438162.202126:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1789438162.202147:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff910700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58dec870-790c-4419-a02f-595f69c3b298+9:2353:x1876361749731584:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 135us (539us total) trans 0 rc 0/0 00010000:00010000:3.0:1789438162.202157:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991c0031600/0x7a8dd0fcbb924ab1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924ab8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438162.202157:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 21 00010000:00010000:3.0:1789438162.202166:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789438162.202189:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991c0031600/0x7a8dd0fcbb924ab1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924ab8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438162.202195:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fabc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769682944:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789438162.202197:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991c0031600/0x7a8dd0fcbb924ab1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924ab8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438162.202219:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438162.202221:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438162.202223:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438162.202236:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fabc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769682816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789438162.202251:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438162.202275:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438162.202297:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769682944 00000100:00100000:0.0:1789438162.202310:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769682944 00010000:00010000:0.0:1789438162.202332:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991c2a55400/0x7a8dd0fcbb924b1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b13 expref: 19 pid: 5832 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438162.202353:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769682816 00000100:00100000:0.0:1789438162.202356:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769682816 00010000:00010000:0.0:1789438162.202380:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991c2a54600/0x7a8dd0fcbb924be5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924bde expref: 20 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438162.202387:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769683072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789438162.202405:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789438162.202419:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+20:3310:x1876361769682944:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789438162.202421:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789438162.202434:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438162.202458:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991c2a55400/0x7a8dd0fcbb924b1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b13 expref: 20 pid: 5832 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.202467:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991c2a55400/0x7a8dd0fcbb924b1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b13 expref: 20 pid: 5832 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.202478:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c2a55400/0x7a8dd0fcbb924b1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb924b13 expref: 20 pid: 5832 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.202488:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438162.202526:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3310:x1876361769682944:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438162.202533:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789438162.202545:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769683072 00000100:00100000:0.0:1789438162.202548:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769683072 00010000:00010000:0.0:1789438162.202559:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991c2a54800/0x7a8dd0fcbb924ab8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924ab1 expref: 19 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438162.202569:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789438162.202582:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3756a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3309:x1876361769682816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789438162.202588:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438162.202592:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991c2a54600/0x7a8dd0fcbb924be5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924bde expref: 19 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.202600:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991c2a54600/0x7a8dd0fcbb924be5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924bde expref: 19 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.202624:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c2a54600/0x7a8dd0fcbb924be5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb924bde expref: 19 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.202633:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438162.202665:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3756a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+18:3309:x1876361769682816:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438162.202671:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789438162.202687:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789438162.202694:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff989f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+17:3311:x1876361769683072:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789438162.202699:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fabc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769682816:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789438162.202705:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438162.202755:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991c2a54800/0x7a8dd0fcbb924ab8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924ab1 expref: 17 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.202767:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991c2a54800/0x7a8dd0fcbb924ab8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924ab1 expref: 17 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.202782:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c2a54800/0x7a8dd0fcbb924ab8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb924ab1 expref: 17 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.202795:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924d43 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.202814:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924d43 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.202828:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924d43 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.202835:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924d43 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.202855:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924d43 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.202862:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924d43 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.202867:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c0031400 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:0.0:1789438162.202871:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924d43 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.202878:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924d43 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.202893:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924d43 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.202902:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789438162.202921:0:8495:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924d43 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438162.202930:0:8495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924d43 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438162.202938:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff989f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+16:3311:x1876361769683072:12345-0@lo:103:ldlm_bl.0 Request processed in 243us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438162.202952:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1789438162.202956:0:8495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c0031400/0x7a8dd0fcbb924d43 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438162.203002:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769683072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789438162.203884:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fabc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769682944:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789438162.203939:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438162.203949:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438162.576152:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438162.576238:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749731712 00000100:00100000:0.0:1789438162.576248:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749731712 00000100:00100000:0.0:1789438162.576303:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 173 00000100:00100000:0.0:1789438162.576314:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+9:5595:x1876361749731712:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789438162.576331:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438162.576352:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9992021c4000/0x7a8dd0fcbb924d4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x483b483084eaa0e0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.576379:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9992021c4000/0x7a8dd0fcbb924d4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0e0 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.576389:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9992021c4000/0x7a8dd0fcbb924d4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0e0 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438162.576398:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9992021c4000, rc 0) 00000100:00100000:0.0:1789438162.576562:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+10:5595:x1876361749731712:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 Request processed in 249us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438162.576570:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 173 00000100:00100000:0.0:1789438162.584216:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438162.584286:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749731840 00000100:00100000:3.0:1789438162.584295:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749731840 00000100:00100000:3.0:1789438162.584372:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 174 00000100:00100000:3.0:1789438162.584381:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+10:5595:x1876361749731840:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789438162.584692:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+10:5595:x1876361749731840:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 Request processed in 311us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438162.584700:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 174 00000100:00100000:1.0:1789438162.605841:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438162.606108:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749731968 00000100:00100000:0.0:1789438162.606119:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749731968 00000100:00100000:0.0:1789438162.606179:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 175 00000100:00100000:0.0:1789438162.606190:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+10:5595:x1876361749731968:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789438162.606452:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+10:5595:x1876361749731968:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 Request processed in 263us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438162.606461:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 175 00000100:00100000:2.0:1789438162.624226:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438162.624558:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749732096 00000100:00100000:3.0:1789438162.624568:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749732096 00000100:00100000:3.0:1789438162.624639:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 176 00000100:00100000:3.0:1789438162.624650:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+10:6142:x1876361749732096:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789438162.627697:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+10:6142:x1876361749732096:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 3035us (3465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438162.627741:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 176 00000100:00100000:2.0:1789438162.641003:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438162.641211:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749732224 00000100:00100000:1.0:1789438162.641233:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749732224 00000100:00100000:1.0:1789438162.642218:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 177 00000100:00100000:1.0:1789438162.642235:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+10:6142:x1876361749732224:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789438162.642740:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+10:6142:x1876361749732224:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 478us (1714us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438162.642749:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 177 00010000:00010000:3.0:1789438162.807066:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438163.839679:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789438163.899215:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789438163.899229:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9991ffa93000 from 4 10000000:01000000:0.0:1789438163.899242:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789438163.899284:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9992021c5600/0x7a8dd0fcbb924d51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438163.899297:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9992021c5600/0x7a8dd0fcbb924d51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438163.899308:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9992021c5600/0x7a8dd0fcbb924d51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438163.899332:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff912d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769683200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789438163.899399:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438163.899459:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c83a6780 going to sleep for 11 seconds 00000100:00100000:0.0:1789438163.899549:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769683200 00000100:00100000:0.0:1789438163.899557:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769683200 00000100:00100000:0.0:1789438163.899613:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789438163.899623:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+16:5836:x1876361769683200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789438163.899636:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438163.899649:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9992021c5a00/0x7a8dd0fcbb924d58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924d51 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438163.899672:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9992021c5a00/0x7a8dd0fcbb924d58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924d51 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438163.899684:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9992021c5a00/0x7a8dd0fcbb924d58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924d51 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438163.899723:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9992021c5a00, rc 0) 00000100:00100000:0.0:1789438163.900591:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+17:5836:x1876361769683200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 965us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438163.900616:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789438163.900680:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff912d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769683200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789438163.900698:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9992021c5600/0x7a8dd0fcbb924d51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924d58 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438163.900725:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9992021c5600/0x7a8dd0fcbb924d51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924d58 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438163.902682:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff912d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769683328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789438163.902920:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438163.902964:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c6d5dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789438163.915060:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769683328 00000100:00100000:1.0:1789438163.915073:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769683328 00000100:00100000:1.0:1789438163.915128:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789438163.915137:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+17:5836:x1876361769683328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789438163.916695:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+17:5836:x1876361769683328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1551us (13767us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438163.916725:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789438163.923792:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff912d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769683328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789438163.923855:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff988700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769683456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789438163.924027:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438163.924066:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f12f6300 going to sleep for 11 seconds 00000100:00100000:1.0:1789438163.925799:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769683456 00000100:00100000:1.0:1789438163.925812:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769683456 00000100:00100000:1.0:1789438163.925932:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789438163.925943:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+17:5836:x1876361769683456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789438163.926171:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+17:5836:x1876361769683456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 230us (2143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438163.926180:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789438163.929515:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff988700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769683456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789438163.939536:0:8563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff913480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8563:1876361769683584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789438163.942099:0:8563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438163.942138:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769683584 00000100:00100000:0.0:1789438163.942146:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769683584 00000100:00100000:0.0:1789438163.942193:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789438163.942202:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+17:8563:x1876361769683584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789438163.942417:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+17:8563:x1876361769683584:12345-0@lo:502:llog_process_th.0 Request processed in 215us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438163.942426:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789438163.942481:0:8563:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c6d5d240 going to sleep for 11 seconds 00000100:00100000:0.0:1789438163.942502:0:8563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff913480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8563:1876361769683584:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789438163.942533:0:8563:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789438163.942543:0:8563:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789438163.942545:0:8563:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789438163.942560:0:8563:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9991ffa93000 00000020:00000080:0.0:1789438163.942563:0:8563:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789438163.946967:0:8563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff988700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8563:1876361769683712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789438163.947055:0:8563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438163.947452:0:8563:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991de1f9180 going to sleep for 11 seconds 00000100:00100000:2.0:1789438163.947666:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769683712 00000100:00100000:2.0:1789438163.947675:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769683712 00000100:00100000:2.0:1789438163.947824:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789438163.947906:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+17:8563:x1876361769683712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789438163.948125:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+17:8563:x1876361769683712:12345-0@lo:502:llog_process_th.0 Request processed in 291us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438163.948132:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789438163.948251:0:8563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff988700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8563:1876361769683712:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789438163.948284:0:8563:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789438163.948292:0:8563:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438163.948294:0:8563:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789438163.948298:0:8563:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789438163.949494:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789438163.949523:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789438163.949620:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9992021c5600/0x7a8dd0fcbb924d51 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924d58 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438163.949640:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9992021c5600/0x7a8dd0fcbb924d51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924d58 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789438163.949650:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789438163.949653:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9991d08f6800 from 4 10000000:01000000:2.0:1789438163.949656:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789438163.949689:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff999202045000/0x7a8dd0fcbb924d5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438163.949698:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff999202045000/0x7a8dd0fcbb924d5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438163.949725:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff999202045000/0x7a8dd0fcbb924d5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438163.949829:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa646300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769683840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789438163.950055:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438163.950128:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f47def00 going to sleep for 11 seconds 00000100:00100000:1.0:1789438163.963669:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769683840 00000100:00100000:1.0:1789438163.963682:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769683840 00000100:00100000:1.0:1789438163.963754:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789438163.963766:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+17:5836:x1876361769683840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789438163.963783:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438163.963803:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991ff9dba00/0x7a8dd0fcbb924d66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924d5f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438163.963911:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991ff9dba00/0x7a8dd0fcbb924d66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924d5f expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438163.963924:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991ff9dba00/0x7a8dd0fcbb924d66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924d5f expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438163.963933:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9dba00, rc 0) 00000100:00100000:1.0:1789438163.964011:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769683840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 248us (13955us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438163.964018:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789438163.964076:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa646300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769683840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789438163.964106:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff999202045000/0x7a8dd0fcbb924d5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924d66 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438163.964115:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff999202045000/0x7a8dd0fcbb924d5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924d66 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438163.964185:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff988700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769683968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789438163.964219:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438163.964248:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991de1f9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789438163.964261:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769683968 00000100:00100000:1.0:1789438163.964265:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769683968 00000100:00100000:1.0:1789438163.964288:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789438163.964294:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769683968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789438163.964523:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769683968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 228us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438163.968951:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789438163.969051:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff988700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769683968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789438163.969105:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff988700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769684096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789438163.969168:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438163.969204:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991de1f9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789438163.969220:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769684096 00000100:00100000:1.0:1789438163.969225:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769684096 00000100:00100000:1.0:1789438163.969260:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789438163.969268:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769684096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789438163.969439:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769684096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438163.969456:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789438163.969500:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff988700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769684096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789438163.972406:0:8566:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff913480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8566:1876361769684224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789438163.972481:0:8566:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438163.972522:0:8566:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c6cbe780 going to sleep for 11 seconds 00000100:00100000:1.0:1789438163.973806:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769684224 00000100:00100000:1.0:1789438163.973818:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769684224 00000100:00100000:1.0:1789438163.973915:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789438163.973926:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+18:8566:x1876361769684224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789438163.974189:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+18:8566:x1876361769684224:12345-0@lo:502:llog_process_th.0 Request processed in 265us (1707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438163.974197:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789438163.980855:0:8566:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff913480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8566:1876361769684224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789438163.980904:0:8566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789438163.980917:0:8566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789438163.980920:0:8566:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789438163.980931:0:8566:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9991d08f6800 00000020:00000080:0.0:1789438163.980934:0:8566:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789438163.981394:0:8566:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff913480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8566:1876361769684352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789438163.981968:0:8566:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438163.982014:0:8566:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c6cbe780 going to sleep for 11 seconds 00000100:00100000:3.0:1789438163.982736:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769684352 00000100:00100000:3.0:1789438163.982746:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769684352 00000100:00100000:3.0:1789438163.982791:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789438163.982802:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+18:8566:x1876361769684352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789438163.983165:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+18:8566:x1876361769684352:12345-0@lo:502:llog_process_th.0 Request processed in 365us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438163.983183:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789438163.983247:0:8566:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff913480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8566:1876361769684352:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789438163.983282:0:8566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789438163.983290:0:8566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789438163.983292:0:8566:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789438163.983298:0:8566:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789438163.983525:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789438163.983554:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789438163.983564:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff999202045000/0x7a8dd0fcbb924d5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924d66 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438163.983576:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff999202045000/0x7a8dd0fcbb924d5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924d66 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789438163.983585:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789438163.983588:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9991d197a000 from 4 10000000:01000000:1.0:1789438163.983591:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789438163.983632:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924d6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438163.983641:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924d6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438163.983650:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924d6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438163.983681:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff988700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769684480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789438163.983744:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438163.983773:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991de1f96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438163.984178:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769684480 00000100:00100000:3.0:1789438163.984184:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769684480 00000100:00100000:3.0:1789438163.984251:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789438163.984260:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769684480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789438163.984269:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438163.984281:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c2a55e00/0x7a8dd0fcbb924d74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924d6d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438163.984303:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c2a55e00/0x7a8dd0fcbb924d74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924d6d expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438163.984313:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c2a55e00/0x7a8dd0fcbb924d74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924d6d expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438163.984321:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a55e00, rc 0) 00000100:00100000:3.0:1789438163.984365:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:5836:x1876361769684480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438163.984372:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789438163.984437:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff988700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769684480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789438163.984450:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924d6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924d74 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438163.984459:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924d6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924d74 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438163.984505:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff988700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769684608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789438163.984543:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438163.990005:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991de1f96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789438163.992616:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769684608 00000100:00100000:0.0:1789438163.992628:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769684608 00000100:00100000:0.0:1789438163.992682:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789438163.992692:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:5836:x1876361769684608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789438163.993250:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:5836:x1876361769684608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 557us (8715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438163.993259:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789438163.998486:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff988700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769684608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789438163.998561:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff988700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769684736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789438163.998638:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438163.998679:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991de1f96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789438163.999108:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769684736 00000100:00100000:2.0:1789438163.999116:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769684736 00000100:00100000:2.0:1789438163.999163:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789438163.999171:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:5836:x1876361769684736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789438163.999342:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:5836:x1876361769684736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438163.999349:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789438163.999395:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff988700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769684736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789438163.999821:0:8567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3754a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8567:1876361769684864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789438163.999874:0:8567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438163.999902:0:8567:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991eb8e7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789438164.000068:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769684864 00000100:00100000:2.0:1789438164.000079:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769684864 00000100:00100000:2.0:1789438164.000119:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789438164.000127:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+19:8567:x1876361769684864:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789438164.000276:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+19:8567:x1876361769684864:12345-0@lo:502:llog_process_th.0 Request processed in 149us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438164.000283:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789438164.001700:0:8567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3754a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8567:1876361769684864:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789438164.001768:0:8567:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789438164.001777:0:8567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789438164.001779:0:8567:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789438164.001786:0:8567:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9991d197a000 00000020:00000080:3.0:1789438164.001789:0:8567:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789438164.002038:0:8567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3754a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8567:1876361769684992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789438164.002098:0:8567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438164.002131:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769684992 00000100:00100000:3.0:1789438164.002137:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769684992 00000100:00100000:3.0:1789438164.002171:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789438164.002180:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:8567:x1876361769684992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789438164.002346:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:8567:x1876361769684992:12345-0@lo:502:llog_process_th.0 Request processed in 167us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438164.002354:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789438164.002398:0:8567:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991eb8e7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438164.002411:0:8567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3754a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:8567:1876361769684992:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789438164.002430:0:8567:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789438164.002434:0:8567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789438164.002436:0:8567:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789438164.002441:0:8567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789438164.002613:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789438164.002632:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789438164.002641:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924d6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924d74 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438164.002653:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924d6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924d74 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438164.854827:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438165.471993:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438165.472041:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438165.472084:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438165.472112:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438165.472139:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749732352 00000100:00100000:1.0:1789438165.472147:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749732352 00000100:00100000:1.0:1789438165.472192:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 193 00000100:00100000:1.0:1789438165.472202:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+10:2353:x1876361749732352:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438165.472277:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+10:2353:x1876361749732352:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 76us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438165.472284:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 193 00000100:00100000:1.0:1789438165.472313:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749732736 00000100:00100000:1.0:1789438165.472316:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749732736 00000100:00100000:1.0:1789438165.472343:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749732608 00000100:00100000:1.0:1789438165.472345:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749732608 00000100:00100000:1.0:1789438165.472359:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 19 00000100:00100000:1.0:1789438165.472365:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+5:2353:x1876361749732736:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438165.472387:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+5:2353:x1876361749732736:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 22us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438165.472393:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 19 00000100:00100000:1.0:1789438165.472402:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 20 00000100:00100000:1.0:1789438165.472407:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+5:2353:x1876361749732608:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438165.472423:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+5:2353:x1876361749732608:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 16us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438165.472428:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 20 00000100:00080000:1.0:1789438165.472528:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789438165.472532:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789438165.475858:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749732480 00000100:00100000:3.0:1789438165.475872:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749732480 00000100:00100000:3.0:1789438165.475991:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 35 00000100:00100000:3.0:1789438165.476001:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+6:2353:x1876361749732480:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438165.476089:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+6:2353:x1876361749732480:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 89us (4103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438165.476111:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 35 00000100:00080000:1.0:1789438165.476662:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789438165.881536:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438166.336020:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769685248:0@lo:400:kworker.0 00000100:00100000:0.0:1789438166.336090:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438166.336149:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769685760:0@lo:400:kworker.0 00000100:00100000:2.0:1789438166.336259:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769685504:0@lo:400:kworker.0 00000100:00100000:1.0:1789438166.336280:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769685120:0@lo:400:kworker.0 00000100:00100000:1.0:1789438166.336320:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438166.336345:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1876361769685632:0@lo:400:kworker.0 00000100:00100000:1.0:1789438166.336365:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438166.336401:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769685248 00000100:00100000:2.0:1789438166.336411:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769685120 00000100:00100000:1.0:1789438166.336418:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769685248 00000100:00100000:2.0:1789438166.336419:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769685120 00000100:00100000:1.0:1789438166.336471:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769685632 00000100:00100000:2.0:1789438166.336472:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789438166.336477:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769685632 00000100:00100000:2.0:1789438166.336484:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1facc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3312:x1876361769685120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438166.336510:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789438166.336531:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769685248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438166.336539:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1facc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3312:x1876361769685120:12345-0@lo:400:kworker.0 Request processed in 56us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438166.336547:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789438166.336575:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769685248:12345-0@lo:400:kworker.0 Request processed in 57us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438166.336584:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789438166.336917:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438166.337005:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769685248:0@lo:400:kworker.0 00000100:00100000:0.0:1789438166.337028:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789438166.337038:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769685376:0@lo:400:kworker.0 00000100:00100000:0.0:1789438166.337065:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438166.337092:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769685376 00000100:00100000:0.0:1789438166.337096:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769685376 00000100:00100000:2.0:1789438166.337147:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789438166.337159:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876361769685632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438166.337196:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876361769685632:12345-0@lo:400:kworker.0 Request processed in 40us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438166.337226:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789438166.337257:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769685120:0@lo:400:kworker.0 00000100:00100000:2.0:1789438166.337268:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1876361769685632:0@lo:400:kworker.0 00000100:00100000:2.0:1789438166.337309:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769685760 00000100:00100000:2.0:1789438166.337693:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769685760 00000100:00100000:2.0:1789438166.337764:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789438166.337772:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769685760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438166.337813:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769685760:12345-0@lo:400:kworker.0 Request processed in 43us (1639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438166.337820:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789438166.337843:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438166.337884:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769685504 00000100:00100000:2.0:1789438166.337888:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769685504 00000100:00100000:2.0:1789438166.337913:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789438166.337920:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa644000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769685504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438166.337957:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa644000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769685504:12345-0@lo:400:kworker.0 Request processed in 38us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438166.337963:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1789438166.337990:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff913480 x1876361769685504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438166.338003:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769685504:0@lo:400:kworker.0 00010000:00080000:2.0:1789438166.338030:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff911c00 x1876361769685760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438166.338039:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769685760:0@lo:400:kworker.0 00000100:00080000:2.0:1789438166.338077:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789438166.338082:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789438166.338085:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789438166.341992:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789438166.342014:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769685376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438166.342160:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769685376:12345-0@lo:400:kworker.0 Request processed in 156us (5093us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438166.342169:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789438166.347948:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769685376:0@lo:400:kworker.0 00000100:00100000:3.0:1789438166.841046:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff98b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769685888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789438166.841110:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438166.842746:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769686016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789438166.842795:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438166.842933:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769685888 00000100:00100000:0.0:1789438166.842941:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769685888 00000100:00100000:0.0:1789438166.842973:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769686016 00000100:00100000:0.0:1789438166.842976:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769686016 00000100:00100000:0.0:1789438166.842989:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789438166.842997:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769685888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789438166.843028:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438166.843074:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769685888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (1963us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438166.843080:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789438166.843095:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789438166.843101:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769686016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789438166.843116:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438166.843273:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769686016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 171us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438166.843280:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1789438166.843585:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff910a80 x1876361769686016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1789438166.844184:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff98b800 x1876361769685888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438166.844204:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff98b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769685888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789438166.844258:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769686016:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789438166.902889:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438167.927413:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789438168.176111:0:8795:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg609-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1789438168.951919:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438169.978883:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438170.603876:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438170.603955:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438170.603997:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438170.604037:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749732992 00000100:00100000:3.0:1789438170.604047:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749732992 00000100:00100000:0.0:1789438170.604082:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438170.604108:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 39 00000100:00100000:3.0:1789438170.604119:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+6:2354:x1876361749732992:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438170.604197:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749732864 00000100:00100000:1.0:1789438170.604203:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749732864 00000100:00100000:3.0:1789438170.604218:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+6:2354:x1876361749732992:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 82us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438170.604227:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 39 00000100:00100000:1.0:1789438170.604250:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 195 00000100:00080000:3.0:1789438170.604252:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789438170.604261:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+10:2354:x1876361749732864:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438170.604292:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+10:2354:x1876361749732864:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 34us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438170.604299:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 195 00000100:00100000:1.0:1789438170.607570:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749733120 00000100:00100000:1.0:1789438170.607594:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749733120 00000100:00100000:1.0:1789438170.607668:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749733248 00000100:00100000:1.0:1789438170.607672:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749733248 00000100:00100000:1.0:1789438170.607699:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:1.0:1789438170.607737:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+5:2352:x1876361749733120:12345-192.168.206.9@tcp:9:kworker.0 00000020:00000080:1.0:1789438170.607776:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924cb0 00000100:00080000:1.0:1789438170.607785:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9990c1cc4000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789438170.607828:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:3.0:1789438170.607942:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789438170.607946:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789438170.607976:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 11 00000100:00100000:3.0:1789438170.607985:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff911500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+5:2352:x1876361749733248:12345-192.168.206.9@tcp:9:kworker.0 00000020:00000080:3.0:1789438170.608045:0:6680:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924cb7 00000100:00080000:3.0:1789438170.608053:0:6680:0:(import.c:65:import_set_state_nolock()) ffff9990c1cc5000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789438170.608076:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789438170.608315:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff911500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+2:2352:x1876361749733248:12345-192.168.206.9@tcp:9:kworker.0 Request processed in 317us (4220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438170.608324:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 11 00010000:00010000:3.0:1789438170.608376:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438170.608498:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438170.608756:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+2:2352:x1876361749733120:12345-192.168.206.9@tcp:9:kworker.0 Request processed in 1048us (4757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438170.608765:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 10 00010000:00010000:1.0:1789438171.006563:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438171.448870:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769686144:0@lo:400:kworker.0 00000100:00100000:1.0:1789438171.448952:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438171.449128:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769686144 00000100:00100000:0.0:1789438171.449137:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769686144 00000100:00100000:0.0:1789438171.449184:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789438171.449194:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3312:x1876361769686144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438171.450802:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fabc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769686528:0@lo:400:kworker.0 00000100:00100000:3.0:1789438171.450856:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438171.450887:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789438171.450892:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff98d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769686656:0@lo:400:kworker.0 00000100:00100000:3.0:1789438171.450914:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438171.450945:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769686528 00000100:00100000:3.0:1789438171.450951:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769686528 00000100:00100000:3.0:1789438171.451004:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789438171.451012:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769686528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438171.451055:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769686528:12345-0@lo:400:kworker.0 Request processed in 44us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438171.451063:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1789438171.451082:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789438171.451127:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991fabc9f80 x1876361769686528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438171.451141:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fabc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769686528:0@lo:400:kworker.0 00000100:00100000:0.0:1789438171.451313:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3312:x1876361769686144:12345-0@lo:400:kworker.0 Request processed in 2119us (2359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438171.451321:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789438171.451357:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fabc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876361769686400:0@lo:400:kworker.0 00000100:00100000:0.0:1789438171.451381:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438171.451417:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789438171.451424:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876361769686272:0@lo:400:kworker.0 00000100:00100000:0.0:1789438171.451443:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438171.451459:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff98e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769686784:0@lo:400:kworker.0 00000100:00100000:0.0:1789438171.451476:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438171.451502:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769686656 00000100:00100000:0.0:1789438171.451506:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769686656 00000100:00100000:0.0:1789438171.451536:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769686400 00000100:00100000:0.0:1789438171.451539:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769686400 00000100:00100000:0.0:1789438171.451562:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769686272 00000100:00100000:0.0:1789438171.451566:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769686272 00000100:00100000:0.0:1789438171.451591:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789438171.451597:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769686656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438171.451640:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769686656:12345-0@lo:400:kworker.0 Request processed in 44us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438171.451647:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789438171.451657:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789438171.451662:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876361769686400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438171.451689:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876361769686400:12345-0@lo:400:kworker.0 Request processed in 26us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438171.451695:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789438171.451722:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789438171.451728:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876361769686272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438171.451753:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876361769686272:12345-0@lo:400:kworker.0 Request processed in 26us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438171.451758:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789438171.451779:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769686784 00000100:00100000:0.0:1789438171.451782:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769686784 00000100:00100000:0.0:1789438171.451805:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789438171.451812:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769686784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438171.451839:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769686784:12345-0@lo:400:kworker.0 Request processed in 28us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438171.451845:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789438171.451870:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876361769686272:0@lo:400:kworker.0 00010000:00080000:0.0:1789438171.451881:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff98e300 x1876361769686784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438171.451897:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff98e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769686784:0@lo:400:kworker.0 00000100:00100000:0.0:1789438171.451907:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fabc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876361769686400:0@lo:400:kworker.0 00000100:00080000:0.0:1789438171.451931:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789438171.451936:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789438171.451950:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff98d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769686656:0@lo:400:kworker.0 00000100:00100000:1.0:1789438171.452363:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769686144:0@lo:400:kworker.0 00000100:00100000:0.0:1789438171.959076:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff98b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769686912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789438171.959139:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438171.959207:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769686912 00000100:00100000:0.0:1789438171.959214:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769686912 00000100:00100000:0.0:1789438171.959252:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789438171.959260:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769686912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789438171.959292:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438171.959327:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769686912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438171.959333:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1789438171.959366:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff98b100 x1876361769686912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438171.959381:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff98b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769686912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789438171.960076:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789438171.960087:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769687040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789438171.960121:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438171.960149:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769687040 00000100:00100000:0.0:1789438171.960153:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769687040 00000100:00100000:0.0:1789438171.960181:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789438171.960198:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769687040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789438171.960216:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438171.960250:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769687040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438171.960255:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1789438171.960283:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff911c00 x1876361769687040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438171.960297:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769687040:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1789438171.993859:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1274be99-2d57-4dac-a13e-a89426512ee0 00000020:00000080:1.0:1789438171.993867:0:6706:0:(genops.c:885:class_export_put()) final put ffff9990c1cc2000/1274be99-2d57-4dac-a13e-a89426512ee0 00000020:00000080:2.0:1789438171.996292:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9990c1cc2000/1274be99-2d57-4dac-a13e-a89426512ee0 for lustre-OST0000 00000020:00000080:2.0:1789438171.996382:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9990c1cc4000 for lustre-OST0000 00010000:00010000:3.0:1789438172.023016:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789438172.593361:0:9038:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg609-server.virtnet: executing yml_node 00010000:00010000:1.0:1789438173.049631:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438174.070934:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789438174.559297:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1274be99-2d57-4dac-a13e-a89426512ee0 00000020:00000080:3.0:1789438174.559306:0:7628:0:(genops.c:885:class_export_put()) final put ffff9990c1cc5800/1274be99-2d57-4dac-a13e-a89426512ee0 00000020:00000080:3.0:1789438174.559329:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9990c1cc5800/1274be99-2d57-4dac-a13e-a89426512ee0 for lustre-OST0001 00000020:00000080:3.0:1789438174.559367:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9990c1cc5000 for lustre-OST0001 00010000:00010000:1.0:1789438175.095007:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438175.706377:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438175.706419:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438175.706613:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749733504 00000100:00100000:2.0:1789438175.706623:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749733504 00000100:00100000:2.0:1789438175.706691:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 43 00000100:00100000:2.0:1789438175.706701:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+6:2355:x1876361749733504:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789438175.706796:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+6:2355:x1876361749733504:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 97us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438175.706803:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 43 00000100:00080000:0.0:1789438175.707471:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789438175.708428:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749733376 00000100:00100000:1.0:1789438175.708439:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749733376 00000100:00100000:1.0:1789438175.708505:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 197 00000100:00100000:1.0:1789438175.708513:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+10:2355:x1876361749733376:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438175.708591:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+10:2355:x1876361749733376:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 79us (2222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438175.708599:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 197 00010000:00010000:3.0:1789438176.121747:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438176.569887:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff989500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769687296:0@lo:400:kworker.0 00000100:00100000:1.0:1789438176.569974:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438176.570029:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff98bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769687808:0@lo:400:kworker.0 00000100:00100000:1.0:1789438176.570054:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438176.570085:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789438176.570090:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff98a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769687424:0@lo:400:kworker.0 00000100:00100000:1.0:1789438176.570108:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438176.570139:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769687296 00000100:00100000:1.0:1789438176.570148:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769687296 00000100:00100000:1.0:1789438176.570191:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769687424 00000100:00100000:1.0:1789438176.570194:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769687424 00000100:00100000:1.0:1789438176.570234:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789438176.570242:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769687296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438176.570296:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769687296:12345-0@lo:400:kworker.0 Request processed in 55us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438176.570304:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789438176.570323:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789438176.570329:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769687424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438176.570367:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769687424:12345-0@lo:400:kworker.0 Request processed in 37us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438176.570373:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789438176.570391:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769687808 00000100:00100000:1.0:1789438176.570394:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769687808 00000100:00100000:1.0:1789438176.570419:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789438176.570425:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769687808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438176.570452:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769687808:12345-0@lo:400:kworker.0 Request processed in 28us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438176.570458:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1789438176.570483:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789438176.570488:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789438176.570523:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff98a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769687424:0@lo:400:kworker.0 00000100:00100000:1.0:1789438176.570533:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff989500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769687296:0@lo:400:kworker.0 00010000:00080000:1.0:1789438176.570552:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff98bb80 x1876361769687808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789438176.570563:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff98bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769687808:0@lo:400:kworker.0 00000100:00100000:3.0:1789438176.572590:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769687552:0@lo:400:kworker.0 00000100:00100000:3.0:1789438176.572689:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438176.572804:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789438176.572812:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff98aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769687168:0@lo:400:kworker.0 00000100:00100000:3.0:1789438176.572847:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438176.572886:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769687680:0@lo:400:kworker.0 00000100:00100000:3.0:1789438176.572916:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438176.572941:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769687680 00000100:00100000:3.0:1789438176.572946:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769687168 00000100:00100000:3.0:1789438176.572953:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769687168 00000100:00100000:2.0:1789438176.572953:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769687680 00000100:00100000:3.0:1789438176.573003:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789438176.573003:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789438176.573012:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3311:x1876361769687168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438176.573013:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769687680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438176.573078:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769687680:12345-0@lo:400:kworker.0 Request processed in 61us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438176.573085:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1789438176.573127:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789438176.573667:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3311:x1876361769687168:12345-0@lo:400:kworker.0 Request processed in 654us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438176.573677:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789438176.574819:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769687552 00000100:00100000:1.0:1789438176.574845:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769687552 00000100:00100000:1.0:1789438176.574923:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789438176.574933:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769687552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438176.575025:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769687552:12345-0@lo:400:kworker.0 Request processed in 95us (2336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438176.575033:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789438176.579645:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff98aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769687168:0@lo:400:kworker.0 00000100:00100000:2.0:1789438176.579675:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769687680:0@lo:400:kworker.0 00010000:00080000:2.0:1789438176.579693:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff988000 x1876361769687552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438176.579705:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769687552:0@lo:400:kworker.0 00000100:00080000:2.0:1789438176.579788:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1789438176.691333:0:9231:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00000100:00100000:0.0:1789438177.078882:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789438177.078916:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769687936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789438177.078932:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff98bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769688064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789438177.079856:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438177.083065:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769688064 00000100:00100000:1.0:1789438177.083094:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769688064 00000100:00100000:1.0:1789438177.083207:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789438177.083220:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769688064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789438177.083278:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438177.083297:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438177.083358:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769688064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (3506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438177.083366:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789438177.083389:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769687936 00000100:00100000:1.0:1789438177.083394:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769687936 00000100:00100000:1.0:1789438177.083410:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789438177.083415:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769687936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789438177.083438:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789438177.083469:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769687936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438177.083475:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1789438177.083560:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff98bb80 x1876361769688064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789438177.083584:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff98bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769688064:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789438177.083586:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff912d80 x1876361769687936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438177.083599:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769687936:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789438177.149345:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438178.167473:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438179.191023:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789438179.729394:0:9329:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00010000:00010000:3.0:1789438180.215137:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438180.830458:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438180.830516:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438180.830588:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749733760 00000100:00100000:1.0:1789438180.830602:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749733760 00000100:00100000:1.0:1789438180.830696:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 47 00000100:00100000:1.0:1789438180.830736:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+6:2355:x1876361749733760:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789438180.830987:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749733632 00000100:00100000:0.0:1789438180.830993:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749733632 00000100:00100000:0.0:1789438180.831030:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 199 00000100:00100000:0.0:1789438180.831039:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+10:2355:x1876361749733632:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789438180.831093:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+10:2355:x1876361749733632:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 55us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438180.831103:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 199 00000100:00100000:1.0:1789438180.831172:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+6:2355:x1876361749733760:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 467us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438180.831180:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 47 00000100:00080000:1.0:1789438180.831204:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789438181.245752:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438181.688042:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff98e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876361769688448:0@lo:400:kworker.0 00000100:00100000:3.0:1789438181.688108:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438181.688379:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff98ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769688192:0@lo:400:kworker.0 00000100:00100000:2.0:1789438181.688424:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438181.688606:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff98c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1876361769688704:0@lo:400:kworker.0 00000100:00100000:2.0:1789438181.688631:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438181.688649:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789438181.688655:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff98df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769688576:0@lo:400:kworker.0 00000100:00100000:2.0:1789438181.688692:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438181.688761:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769688448 00000100:00100000:2.0:1789438181.688783:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769688448 00000100:00100000:2.0:1789438181.688833:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769688704 00000100:00100000:2.0:1789438181.688836:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769688704 00000100:00100000:2.0:1789438181.689036:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789438181.689049:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876361769688448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438181.689097:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876361769688448:12345-0@lo:400:kworker.0 Request processed in 52us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438181.689105:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789438181.689138:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789438181.689144:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876361769688704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438181.689255:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789438181.689267:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff98d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876361769688320:0@lo:400:kworker.0 00000100:00100000:1.0:1789438181.689336:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769688576 00000100:00100000:1.0:1789438181.689341:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769688576 00000100:00100000:1.0:1789438181.689372:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789438181.689379:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769688576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438181.689427:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876361769688704:12345-0@lo:400:kworker.0 Request processed in 283us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438181.689434:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1789438181.689538:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789438181.689550:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789438181.695301:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769688192 00000100:00100000:0.0:1789438181.695317:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769688192 00000100:00100000:0.0:1789438181.695375:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789438181.695385:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3312:x1876361769688192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438181.695648:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438181.695699:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff98ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769688832:0@lo:400:kworker.0 00000100:00100000:3.0:1789438181.695744:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438181.695801:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff98e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876361769688448:0@lo:400:kworker.0 00000100:00100000:3.0:1789438181.695838:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769688832 00000100:00100000:3.0:1789438181.695843:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769688832 00000100:00100000:3.0:1789438181.697259:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789438181.697274:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769688832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438181.697358:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769688832:12345-0@lo:400:kworker.0 Request processed in 89us (1613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438181.697366:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1789438181.697393:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789438181.697423:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff98ed80 x1876361769688832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438181.697436:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff98ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769688832:0@lo:400:kworker.0 00000100:00100000:3.0:1789438181.697489:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769688320 00000100:00100000:3.0:1789438181.697494:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769688320 00000100:00100000:3.0:1789438181.697530:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789438181.697537:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876361769688320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438181.697572:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876361769688320:12345-0@lo:400:kworker.0 Request processed in 35us (1925us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438181.697578:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789438181.697600:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff98d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876361769688320:0@lo:400:kworker.0 00000100:00100000:1.0:1789438181.698270:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769688576:12345-0@lo:400:kworker.0 Request processed in 8889us (9574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438181.698280:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789438181.701726:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff98c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1876361769688704:0@lo:400:kworker.0 00010000:00080000:2.0:1789438181.701767:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff98df80 x1876361769688576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438181.701778:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff98df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769688576:0@lo:400:kworker.0 00000100:00100000:0.0:1789438181.708654:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3312:x1876361769688192:12345-0@lo:400:kworker.0 Request processed in 13262us (20228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438181.708759:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789438181.710371:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff98ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769688192:0@lo:400:kworker.0 00000100:00100000:3.0:1789438182.198959:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769688960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789438182.199052:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438182.199501:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769688960 00000100:00100000:0.0:1789438182.199525:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769688960 00000100:00100000:0.0:1789438182.199593:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789438182.199606:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769688960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789438182.199654:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438182.199742:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769688960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438182.199750:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1789438182.199796:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff912d80 x1876361769688960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438182.199831:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769688960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789438182.200260:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff98ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769689088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789438182.200306:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438182.200358:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769689088 00000100:00100000:2.0:1789438182.200373:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769689088 00000100:00100000:2.0:1789438182.200421:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789438182.200431:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff912d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769689088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789438182.200552:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789438182.200982:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff912d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769689088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 207us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438182.200993:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1789438182.201050:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff98ed80 x1876361769689088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438182.201072:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff98ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769689088:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789438182.263947:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789438182.755048:0:9427:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00010000:00010000:1.0:1789438183.286951:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438184.328564:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789438184.354393:0:9475:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Sep 14 22:09:42 EDT 2026 00010000:00010000:3.0:1789438185.335225:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438185.943220:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438185.943273:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438185.943304:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749733888 00000100:00100000:3.0:1789438185.943315:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749733888 00000100:00100000:3.0:1789438185.943363:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 201 00000100:00100000:3.0:1789438185.943383:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+10:2353:x1876361749733888:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438185.943472:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+10:2353:x1876361749733888:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 93us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438185.943479:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 201 00000100:00100000:1.0:1789438185.943538:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749734016 00000100:00100000:1.0:1789438185.943544:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749734016 00000100:00100000:1.0:1789438185.943596:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 51 00000100:00100000:1.0:1789438185.943604:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+6:2353:x1876361749734016:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438185.943637:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+6:2353:x1876361749734016:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 36us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438185.943643:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 51 00000100:00080000:3.0:1789438185.943923:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789438186.359168:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438186.807756:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff98f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769689216:0@lo:400:kworker.0 00000100:00100000:2.0:1789438186.807834:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438186.807882:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff98ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1876361769689728:0@lo:400:kworker.0 00000100:00100000:2.0:1789438186.807909:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438186.807936:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789438186.807943:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff98ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769689600:0@lo:400:kworker.0 00000100:00100000:2.0:1789438186.807976:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438186.808003:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff98f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769689344:0@lo:400:kworker.0 00000100:00100000:0.0:1789438186.808508:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff98ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876361769689472:0@lo:400:kworker.0 00000100:00100000:0.0:1789438186.808586:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438186.808630:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769689216 00000100:00100000:0.0:1789438186.808638:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769689216 00000100:00100000:0.0:1789438186.808693:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789438186.808702:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3312:x1876361769689216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438186.808768:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3312:x1876361769689216:12345-0@lo:400:kworker.0 Request processed in 66us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438186.808775:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789438186.808805:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769689600 00000100:00100000:0.0:1789438186.808809:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769689600 00000100:00100000:0.0:1789438186.808842:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789438186.808849:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769689600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438186.808880:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769689600:12345-0@lo:400:kworker.0 Request processed in 32us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438186.808887:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789438186.808903:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769689728 00000100:00100000:0.0:1789438186.808906:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769689728 00000100:00100000:0.0:1789438186.808928:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769689472 00000100:00100000:0.0:1789438186.808931:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769689472 00000100:00100000:0.0:1789438186.808949:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789438186.808955:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876361769689728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438186.808984:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876361769689728:12345-0@lo:400:kworker.0 Request processed in 29us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438186.808989:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789438186.809001:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789438186.809007:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876361769689472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438186.809069:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876361769689472:12345-0@lo:400:kworker.0 Request processed in 62us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438186.809075:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1789438186.809109:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff98ed80 x1876361769689600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438186.809122:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff98ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769689600:0@lo:400:kworker.0 00000100:00100000:0.0:1789438186.809133:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff98f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769689216:0@lo:400:kworker.0 00000100:00100000:0.0:1789438186.809142:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff98ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1876361769689728:0@lo:400:kworker.0 00000100:00080000:0.0:1789438186.809164:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789438186.809168:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789438186.809185:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff98ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876361769689472:0@lo:400:kworker.0 00000100:00100000:2.0:1789438186.809469:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438186.809544:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff98df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769689856:0@lo:400:kworker.0 00000100:00100000:2.0:1789438186.809574:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438186.809630:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769689344 00000100:00100000:0.0:1789438186.809636:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769689344 00000100:00100000:0.0:1789438186.809730:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789438186.809737:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769689344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438186.809776:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769689344:12345-0@lo:400:kworker.0 Request processed in 39us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438186.809782:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789438186.809809:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff98f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769689344:0@lo:400:kworker.0 00000100:00100000:2.0:1789438186.809866:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769689856 00000100:00100000:2.0:1789438186.809870:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769689856 00000100:00100000:2.0:1789438186.809940:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789438186.809947:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769689856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438186.809983:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769689856:12345-0@lo:400:kworker.0 Request processed in 36us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438186.809988:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1789438186.815798:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789438186.815867:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff98df80 x1876361769689856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438186.815885:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff98df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769689856:0@lo:400:kworker.0 00000100:00100000:0.0:1789438187.321479:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789438187.321629:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769689984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789438187.321758:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438187.322194:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769689984 00000100:00100000:3.0:1789438187.322205:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769689984 00000100:00100000:3.0:1789438187.322280:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789438187.322291:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769689984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789438187.322338:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789438187.322414:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769689984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438187.322422:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789438187.322445:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789438187.322456:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff98c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769690112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789438187.322488:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438187.322535:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769690112 00000100:00100000:3.0:1789438187.322539:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769690112 00000100:00100000:3.0:1789438187.322559:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789438187.322566:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769690112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789438187.322591:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789438187.322624:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769690112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438187.322631:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1789438187.322666:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff98c700 x1876361769690112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438187.322699:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff98c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769690112:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789438187.322765:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991f3755c00 x1876361769689984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438187.322778:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769689984:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789438187.383982:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438188.410059:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438189.431988:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438190.458945:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438191.066185:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438191.066646:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749734144 00000100:00100000:0.0:1789438191.066657:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749734144 00000100:00100000:0.0:1789438191.066983:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 203 00000100:00100000:0.0:1789438191.066997:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+10:2355:x1876361749734144:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789438191.067091:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+10:2355:x1876361749734144:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 98us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438191.067099:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 203 00000100:00100000:3.0:1789438191.068246:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438191.068325:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749734272 00000100:00100000:0.0:1789438191.068333:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749734272 00000100:00100000:0.0:1789438191.068421:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 55 00000100:00100000:0.0:1789438191.068430:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+6:2356:x1876361749734272:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789438191.068500:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+6:2356:x1876361749734272:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 70us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438191.068507:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 55 00000100:00080000:3.0:1789438191.073335:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789438191.478876:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438191.930342:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769690240:0@lo:400:kworker.0 00000100:00100000:3.0:1789438191.930411:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438191.930570:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769690240 00000100:00100000:0.0:1789438191.930578:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769690240 00000100:00100000:0.0:1789438191.930622:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789438191.930631:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3312:x1876361769690240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438191.933088:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769690368:0@lo:400:kworker.0 00000100:00100000:0.0:1789438191.936688:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3312:x1876361769690240:12345-0@lo:400:kworker.0 Request processed in 6049us (6267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438191.936703:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789438191.936989:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438191.937029:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789438191.937041:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769690496:0@lo:400:kworker.0 00000100:00100000:3.0:1789438191.937069:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438191.937107:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769690368 00000100:00100000:3.0:1789438191.937115:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769690368 00000100:00100000:3.0:1789438191.937149:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769690496 00000100:00100000:3.0:1789438191.937152:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769690496 00000100:00100000:3.0:1789438191.937180:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789438191.937188:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769690368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438191.937237:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769690368:12345-0@lo:400:kworker.0 Request processed in 50us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438191.937244:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789438191.937458:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789438191.937467:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769690496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438191.937521:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769690496:12345-0@lo:400:kworker.0 Request processed in 56us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438191.937655:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1789438191.937678:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789438191.938761:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789438191.938775:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f419a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769690880:0@lo:400:kworker.0 00000100:00100000:2.0:1789438191.938959:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438191.939000:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769690880 00000100:00100000:2.0:1789438191.939006:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769690880 00000100:00100000:2.0:1789438191.939056:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789438191.939064:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769690880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438191.939105:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769690880:12345-0@lo:400:kworker.0 Request processed in 42us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438191.939112:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1789438191.939147:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991f419a300 x1876361769690880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438191.939159:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f419a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769690880:0@lo:400:kworker.0 00000100:00080000:2.0:1789438191.939199:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789438191.939212:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769690496:0@lo:400:kworker.0 00000100:00100000:3.0:1789438191.939236:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769690368:0@lo:400:kworker.0 00000100:00100000:0.0:1789438191.939586:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769690624:0@lo:400:kworker.0 00000100:00100000:0.0:1789438191.939622:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438191.939649:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789438191.939656:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769690752:0@lo:400:kworker.0 00000100:00100000:0.0:1789438191.939681:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438191.939749:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769690624 00000100:00100000:0.0:1789438191.939753:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769690624 00000100:00100000:2.0:1789438191.939771:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769690752 00000100:00100000:2.0:1789438191.939778:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769690752 00000100:00100000:2.0:1789438191.939824:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789438191.939831:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769690752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438191.940051:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769690752:12345-0@lo:400:kworker.0 Request processed in 220us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438191.940059:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789438191.943556:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789438191.943581:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769690624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438191.943662:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769690624:12345-0@lo:400:kworker.0 Request processed in 94us (4039us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438191.943669:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789438191.943912:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769690752:0@lo:400:kworker.0 00010000:00080000:2.0:1789438191.943932:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991c7e8f800 x1876361769690624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438191.943943:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769690624:0@lo:400:kworker.0 00000100:00080000:2.0:1789438191.943975:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789438191.943980:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789438191.946606:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769690240:0@lo:400:kworker.0 00000100:00100000:2.0:1789438192.440918:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789438192.440939:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769691136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789438192.441005:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438192.441064:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769691136 00000100:00100000:2.0:1789438192.441071:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769691136 00000100:00100000:2.0:1789438192.441113:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789438192.441121:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769691136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789438192.441151:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789438192.441222:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769691136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438192.441229:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1789438192.441251:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff86ea00 x1876361769691136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789438192.441269:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769691136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789438192.441937:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff989500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769691008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789438192.441976:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438192.442012:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769691008 00000100:00100000:2.0:1789438192.442017:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769691008 00000100:00100000:2.0:1789438192.442051:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789438192.442058:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769691008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789438192.442078:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789438192.442112:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769691008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438192.442118:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1789438192.442144:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff989500 x1876361769691008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438192.442158:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff989500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769691008:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789438192.505352:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438193.533035:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438194.556161:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438195.574873:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438196.193431:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438196.193953:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438196.194011:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749734400 00000100:00100000:1.0:1789438196.194020:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749734400 00000100:00100000:2.0:1789438196.194073:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749734528 00000100:00100000:2.0:1789438196.194078:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749734528 00000100:00100000:1.0:1789438196.194099:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 205 00000100:00100000:1.0:1789438196.194108:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+10:2354:x1876361749734400:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789438196.194115:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 59 00000100:00100000:2.0:1789438196.194120:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+6:2353:x1876361749734528:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789438196.194240:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+6:2353:x1876361749734528:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 118us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438196.194247:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 59 00000100:00080000:2.0:1789438196.194270:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789438196.197095:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+10:2354:x1876361749734400:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 2979us (3660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438196.197109:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 205 00010000:00010000:3.0:1789438196.598886:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438197.048934:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769691392:0@lo:400:kworker.0 00000100:00100000:1.0:1789438197.048982:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769691264:0@lo:400:kworker.0 00000100:00100000:3.0:1789438197.049020:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438197.049033:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438197.049127:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769691264 00000100:00100000:3.0:1789438197.049135:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769691264 00000100:00100000:2.0:1789438197.049164:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769691392 00000100:00100000:2.0:1789438197.049169:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769691392 00000100:00100000:2.0:1789438197.049207:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789438197.049216:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769691392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438197.049286:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769691392:12345-0@lo:400:kworker.0 Request processed in 71us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438197.049293:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789438197.062395:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1876361769691776:0@lo:400:kworker.0 00000100:00100000:1.0:1789438197.062489:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438197.062544:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789438197.062555:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3121880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769691648:0@lo:400:kworker.0 00000100:00100000:1.0:1789438197.062582:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438197.062620:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769691776 00000100:00100000:1.0:1789438197.062628:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769691776 00000100:00100000:1.0:1789438197.062675:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789438197.062683:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876361769691776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438197.062749:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876361769691776:12345-0@lo:400:kworker.0 Request processed in 67us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438197.062772:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789438197.062795:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769691648 00000100:00100000:1.0:1789438197.062799:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769691648 00000100:00080000:0.0:1789438197.063715:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789438197.063721:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789438197.063849:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1876361769691776:0@lo:400:kworker.0 00000100:00100000:0.0:1789438197.063900:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876361769691520:0@lo:400:kworker.0 00000100:00100000:0.0:1789438197.063938:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438197.063970:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789438197.063976:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3123800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769691904:0@lo:400:kworker.0 00000100:00100000:0.0:1789438197.063998:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438197.066401:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769691520 00000100:00100000:2.0:1789438197.066415:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769691520 00000100:00100000:2.0:1789438197.066491:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789438197.066501:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876361769691520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438197.066601:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876361769691520:12345-0@lo:400:kworker.0 Request processed in 102us (2661us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438197.066609:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1789438197.066632:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789438197.066670:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769691392:0@lo:400:kworker.0 00000100:00100000:2.0:1789438197.067599:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789438197.067615:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3312:x1876361769691264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438197.067690:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3312:x1876361769691264:12345-0@lo:400:kworker.0 Request processed in 82us (18657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438197.067697:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789438197.067780:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769691264:0@lo:400:kworker.0 00000100:00100000:0.0:1789438197.067905:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876361769691520:0@lo:400:kworker.0 00000100:00100000:1.0:1789438197.068484:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769691904 00000100:00100000:1.0:1789438197.068493:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769691904 00000100:00100000:1.0:1789438197.068547:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789438197.068554:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769691648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438197.068605:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769691648:12345-0@lo:400:kworker.0 Request processed in 52us (6022us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438197.068611:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789438197.068624:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789438197.068630:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769691904:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789438197.069110:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789438197.069152:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991c3121880 x1876361769691648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438197.069682:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3121880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769691648:0@lo:400:kworker.0 00000100:00100000:1.0:1789438197.072520:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769691904:12345-0@lo:400:kworker.0 Request processed in 3880us (8511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438197.072535:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1789438197.077665:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991c3123800 x1876361769691904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438197.077684:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3123800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769691904:0@lo:400:kworker.0 00000100:00100000:2.0:1789438197.558992:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff989180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769692032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789438197.559066:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438197.559089:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789438197.559105:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3123800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769692160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789438197.560400:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769692032 00000100:00100000:2.0:1789438197.560412:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769692032 00000100:00100000:2.0:1789438197.560476:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789438197.560487:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769692032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789438197.560527:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438197.560993:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438197.561114:0:6684:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1789438197.561124:0:6684:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1789438197.561931:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769692032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1443us (2861us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438197.561942:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789438197.561967:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769692160 00000100:00100000:2.0:1789438197.561973:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769692160 00000100:00100000:2.0:1789438197.561998:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789438197.562004:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769692160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789438197.562028:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:3.0:1789438197.562750:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff989180 x1876361769692032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438197.562789:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff989180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769692032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789438197.563698:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769692160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1689us (2702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438197.563725:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1789438197.563827:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991c3123800 x1876361769692160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438197.564668:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3123800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769692160:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789438197.622942:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438198.650246:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789438198.734686:0:10106:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 22:09:57 (1789438197) === 00000100:00100000:3.0:1789438199.107200:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438199.107306:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749734656 00000100:00100000:1.0:1789438199.107315:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749734656 00000100:00100000:1.0:1789438199.107380:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 207 00000100:00100000:1.0:1789438199.107390:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+10:8142:x1876361749734656:12345-192.168.206.9@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789438199.107404:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438199.107423:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991ff9db600/0x7a8dd0fcbb924d7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x483b483084eaa0e7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438199.107459:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991ff9db600/0x7a8dd0fcbb924d7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0e7 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438199.107497:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991ff9db600/0x7a8dd0fcbb924d7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0e7 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438199.107505:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9db600, rc 0) 00000100:00100000:1.0:1789438199.107623:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+11:8142:x1876361749734656:12345-192.168.206.9@tcp:101:mount.lustre.0 Request processed in 233us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438199.107630:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 207 00000100:00100000:0.0:1789438199.114934:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438199.115017:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749734784 00000100:00100000:3.0:1789438199.115027:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749734784 00000100:00100000:3.0:1789438199.115081:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 208 00000100:00100000:3.0:1789438199.115091:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+11:8142:x1876361749734784:12345-192.168.206.9@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789438199.116187:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+11:8142:x1876361749734784:12345-192.168.206.9@tcp:501:mount.lustre.0 Request processed in 275us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438199.116198:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 208 00000100:00100000:0.0:1789438199.118080:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438199.118165:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749734912 00000100:00100000:1.0:1789438199.118173:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749734912 00000100:00100000:1.0:1789438199.118261:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 209 00000100:00100000:1.0:1789438199.118271:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+11:8142:x1876361749734912:12345-192.168.206.9@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789438199.118665:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+11:8142:x1876361749734912:12345-192.168.206.9@tcp:503:mount.lustre.0 Request processed in 394us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438199.118674:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 209 00000100:00100000:0.0:1789438199.121534:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438199.122096:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749735040 00000100:00100000:2.0:1789438199.122107:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749735040 00000100:00100000:2.0:1789438199.122148:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 210 00000100:00100000:2.0:1789438199.122157:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+11:8146:x1876361749735040:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789438199.122461:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+11:8146:x1876361749735040:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 304us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438199.122477:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 210 00000100:00100000:0.0:1789438199.137821:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438199.137965:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749735168 00000100:00100000:2.0:1789438199.138041:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749735168 00000100:00100000:2.0:1789438199.138096:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 211 00000100:00100000:2.0:1789438199.138106:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+11:8146:x1876361749735168:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789438199.138662:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+11:8146:x1876361749735168:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 555us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438199.138672:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 211 00000100:00100000:0.0:1789438199.149149:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438199.149226:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749735296 00000100:00100000:3.0:1789438199.149237:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749735296 00000100:00100000:3.0:1789438199.149289:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 212 00000100:00100000:3.0:1789438199.149298:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+11:8142:x1876361749735296:12345-192.168.206.9@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789438199.149315:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438199.149332:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c2a55600/0x7a8dd0fcbb924d82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x483b483084eaa111 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438199.149359:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c2a55600/0x7a8dd0fcbb924d82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa111 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438199.149383:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c2a55600/0x7a8dd0fcbb924d82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa111 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438199.149392:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a55600, rc 0) 00000100:00100000:3.0:1789438199.149466:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+12:8142:x1876361749735296:12345-192.168.206.9@tcp:101:mount.lustre.0 Request processed in 169us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438199.149482:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 212 00000100:00100000:0.0:1789438199.153792:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438199.153879:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749735424 00000100:00100000:2.0:1789438199.153901:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749735424 00000100:00100000:2.0:1789438199.153952:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 213 00000100:00100000:2.0:1789438199.153963:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+12:8142:x1876361749735424:12345-192.168.206.9@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789438199.153987:0:5833:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789438199.154003:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789438199.154007:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789438199.154010:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789438199.154013:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789438199.155948:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+12:8142:x1876361749735424:12345-192.168.206.9@tcp:256:mount.lustre.0 Request processed in 1977us (2155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438199.155960:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 213 00000100:00100000:0.0:1789438199.159378:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438199.159507:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749735552 00000100:00100000:1.0:1789438199.159517:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749735552 00000100:00100000:1.0:1789438199.159745:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 214 00000100:00100000:1.0:1789438199.159756:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+12:8142:x1876361749735552:12345-192.168.206.9@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789438199.159773:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438199.159791:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991ff9da200/0x7a8dd0fcbb924d89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x483b483084eaa118 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438199.159818:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991ff9da200/0x7a8dd0fcbb924d89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa118 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438199.159829:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991ff9da200/0x7a8dd0fcbb924d89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa118 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438199.159865:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9da200, rc 0) 00000100:00100000:1.0:1789438199.159913:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+13:8142:x1876361749735552:12345-192.168.206.9@tcp:101:mount.lustre.0 Request processed in 160us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438199.159920:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 214 00000100:00100000:0.0:1789438199.162462:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438199.162644:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749735680 00000100:00100000:2.0:1789438199.162652:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749735680 00000100:00100000:2.0:1789438199.162754:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 215 00000100:00100000:2.0:1789438199.162763:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+13:8142:x1876361749735680:12345-192.168.206.9@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789438199.163856:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+13:8142:x1876361749735680:12345-192.168.206.9@tcp:501:mount.lustre.0 Request processed in 1089us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438199.163865:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 215 00000100:00100000:0.0:1789438199.166100:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438199.166177:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749735808 00000100:00100000:1.0:1789438199.166187:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749735808 00000100:00100000:1.0:1789438199.166237:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 216 00000100:00100000:1.0:1789438199.166246:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+13:8142:x1876361749735808:12345-192.168.206.9@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789438199.166464:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+13:8142:x1876361749735808:12345-192.168.206.9@tcp:503:mount.lustre.0 Request processed in 219us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438199.166472:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 216 00000100:00100000:0.0:1789438199.169830:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438199.169964:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749735936 00000100:00100000:1.0:1789438199.169974:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749735936 00000100:00100000:1.0:1789438199.170029:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 217 00000100:00100000:1.0:1789438199.170039:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+13:8148:x1876361749735936:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789438199.170260:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+13:8148:x1876361749735936:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 222us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438199.170267:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 217 00000100:00100000:0.0:1789438199.172817:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438199.172981:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749736064 00000100:00100000:2.0:1789438199.172989:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749736064 00000100:00100000:2.0:1789438199.173030:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 218 00000100:00100000:2.0:1789438199.173038:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+13:8148:x1876361749736064:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789438199.179129:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+13:8148:x1876361749736064:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 6079us (6309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438199.179144:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 218 00000100:00100000:0.0:1789438199.191936:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438199.192085:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749736192 00000100:00100000:1.0:1789438199.192095:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749736192 00000100:00100000:1.0:1789438199.192142:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:1.0:1789438199.192151:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2352:x1876361749736192:12345-192.168.206.9@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789438199.192179:0:5840:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from c1969457-1646-49ba-87ff-a507cb42c3bf@192.168.206.9@tcp t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:1.0:1789438199.192215:0:5840:0:(genops.c:1384:class_connect()) connect: client c1969457-1646-49ba-87ff-a507cb42c3bf, cookie 0x7a8dd0fcbb924d90 00000004:00100000:1.0:1789438199.192257:0:5840:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:1.0:1789438199.192698:0:5840:0:(import.c:65:import_set_state_nolock()) ffff9990c2511000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789438199.193044:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1969457-1646-49ba-87ff-a507cb42c3bf+6:2352:x1876361749736192:12345-192.168.206.9@tcp:38:mount.lustre.0 Request processed in 891us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438199.193053:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:1.0:1789438199.197639:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438199.197741:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749736576 00000100:00100000:2.0:1789438199.197762:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749736576 00000100:00100000:2.0:1789438199.197827:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 63 00000100:00100000:2.0:1789438199.197957:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+6:2355:x1876361749736576:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789438199.198041:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+6:2355:x1876361749736576:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 205us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438199.198049:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 63 00000100:00080000:3.0:1789438199.198432:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789438199.199798:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438199.200199:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438199.200771:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749736320 00000100:00100000:0.0:1789438199.200781:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749736320 00000100:00080000:3.0:1789438199.200935:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789438199.200973:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749736448 00000100:00100000:0.0:1789438199.200977:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749736448 00000100:00100000:0.0:1789438199.201020:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 11 00000100:00100000:0.0:1789438199.201031:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff989180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1969457-1646-49ba-87ff-a507cb42c3bf+7:0:x1876361749736320:12345-192.168.206.9@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789438199.201070:0:7624:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789438199.201149:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff989180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1969457-1646-49ba-87ff-a507cb42c3bf+7:0:x1876361749736320:12345-192.168.206.9@tcp:41:mount.lustre.0 Request processed in 120us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438199.201156:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 11 00000100:00100000:0.0:1789438199.201174:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 12 00000100:00100000:0.0:1789438199.201181:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1969457-1646-49ba-87ff-a507cb42c3bf+6:8142:x1876361749736448:12345-192.168.206.9@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789438199.201192:0:7624:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789438199.201215:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1969457-1646-49ba-87ff-a507cb42c3bf+6:8142:x1876361749736448:12345-192.168.206.9@tcp:41:mount.lustre.0 Request processed in 35us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438199.201234:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 12 00000100:00100000:1.0:1789438199.204276:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438199.204355:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749736704 00000100:00100000:0.0:1789438199.204424:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749736704 00000100:00100000:0.0:1789438199.204508:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:0.0:1789438199.204517:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1969457-1646-49ba-87ff-a507cb42c3bf+6:8142:x1876361749736704:12345-192.168.206.9@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789438199.204595:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1969457-1646-49ba-87ff-a507cb42c3bf+6:8142:x1876361749736704:12345-192.168.206.9@tcp:40:mount.lustre.0 Request processed in 79us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438199.204602:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:2.0:1789438199.206546:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438199.206589:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438199.206615:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749736832 00000100:00100000:2.0:1789438199.206622:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749736832 00000100:00100000:2.0:1789438199.206651:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749736960 00000100:00100000:2.0:1789438199.206654:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749736960 00000100:00100000:2.0:1789438199.206671:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 12 00000100:00100000:2.0:1789438199.206677:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1876361749736832:12345-192.168.206.9@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789438199.206703:0:6682:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from c1969457-1646-49ba-87ff-a507cb42c3bf@192.168.206.9@tcp t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:2.0:1789438199.206748:0:6682:0:(genops.c:1384:class_connect()) connect: client c1969457-1646-49ba-87ff-a507cb42c3bf, cookie 0x7a8dd0fcbb924d97 00002000:00100000:2.0:1789438199.206759:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c1969457-1646-49ba-87ff-a507cb42c3bf/ffff9991fa75d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789438199.206779:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:2.0:1789438199.206985:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789438199.207012:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9991fa75b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789438199.207073:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1969457-1646-49ba-87ff-a507cb42c3bf+6:2352:x1876361749736832:12345-192.168.206.9@tcp:8:mount.lustre.0 Request processed in 394us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438199.207080:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 12 00000100:00100000:1.0:1789438199.207092:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:1.0:1789438199.207100:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1876361749736960:12345-192.168.206.9@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789438199.207119:0:8192:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from c1969457-1646-49ba-87ff-a507cb42c3bf@192.168.206.9@tcp t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:1.0:1789438199.207139:0:8192:0:(genops.c:1384:class_connect()) connect: client c1969457-1646-49ba-87ff-a507cb42c3bf, cookie 0x7a8dd0fcbb924d9e 00002000:00100000:1.0:1789438199.207146:0:8192:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c1969457-1646-49ba-87ff-a507cb42c3bf/ffff9990c2514800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789438199.207160:0:8192:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1789438199.207750:0:8192:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789438199.207767:0:8192:0:(import.c:65:import_set_state_nolock()) ffff9990c2517800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789438199.207802:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1969457-1646-49ba-87ff-a507cb42c3bf+6:2352:x1876361749736960:12345-192.168.206.9@tcp:8:mount.lustre.0 Request processed in 702us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438199.207810:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:2.0:1789438199.210454:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438199.210530:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749737088 00000100:00100000:0.0:1789438199.210539:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749737088 00000100:00100000:0.0:1789438199.210596:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 1 00000100:00100000:0.0:1789438199.210606:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1969457-1646-49ba-87ff-a507cb42c3bf+6:8142:x1876361749737088:12345-192.168.206.9@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789438199.210670:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789438199.210763:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1969457-1646-49ba-87ff-a507cb42c3bf+6:8142:x1876361749737088:12345-192.168.206.9@tcp:33:mount.lustre.0 Request processed in 159us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438199.210771:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 1 00010000:00010000:0.0:1789438199.670908:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789438200.179770:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c1969457-1646-49ba-87ff-a507cb42c3bf 00000001:00100000:0.0:1789438200.673427:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c1969457-1646-49ba-87ff-a507cb42c3bf 00010000:00010000:3.0:1789438200.698448:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438201.718882:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438202.168832:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769692672:0@lo:400:kworker.0 00000100:00100000:1.0:1789438202.168900:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438202.168972:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789438202.168979:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769692288:0@lo:400:kworker.0 00000100:00100000:1.0:1789438202.169007:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438202.169056:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769692800:0@lo:400:kworker.0 00000100:00100000:1.0:1789438202.169081:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438202.169115:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769692800 00000100:00100000:1.0:1789438202.169124:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769692800 00000100:00100000:1.0:1789438202.169175:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789438202.169184:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769692800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438202.169232:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769692800:12345-0@lo:400:kworker.0 Request processed in 50us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438202.169238:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1789438202.169258:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789438202.169287:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769692800:0@lo:400:kworker.0 00000100:00100000:0.0:1789438202.169373:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769692672 00000100:00100000:0.0:1789438202.169378:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769692672 00000100:00100000:0.0:1789438202.169418:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789438202.169438:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769692672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438202.169473:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769692672:12345-0@lo:400:kworker.0 Request processed in 37us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438202.169489:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789438202.169799:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3121500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769692416:0@lo:400:kworker.0 00000100:00100000:2.0:1789438202.169835:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438202.169863:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769692928:0@lo:400:kworker.0 00000100:00100000:2.0:1789438202.169885:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438202.169904:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789438202.169911:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769692544:0@lo:400:kworker.0 00000100:00100000:2.0:1789438202.169929:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438202.169951:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769692928 00000100:00100000:2.0:1789438202.169954:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769692928 00000100:00100000:2.0:1789438202.169982:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789438202.169988:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769692928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438202.170034:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769692928:12345-0@lo:400:kworker.0 Request processed in 46us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438202.170040:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1789438202.170071:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991c3123b80 x1876361769692928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438202.170094:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769692928:0@lo:400:kworker.0 00000100:00100000:3.0:1789438202.170178:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769692288 00000100:00100000:3.0:1789438202.170183:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769692288 00000100:00100000:3.0:1789438202.170215:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789438202.170223:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3311:x1876361769692288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438202.170256:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3311:x1876361769692288:12345-0@lo:400:kworker.0 Request processed in 34us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438202.170262:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789438202.171206:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769692416 00000100:00100000:0.0:1789438202.171215:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769692416 00000100:00100000:0.0:1789438202.171257:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769692544 00000100:00100000:0.0:1789438202.171261:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769692544 00000100:00100000:0.0:1789438202.171287:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789438202.171294:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769692416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438202.171348:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769692416:12345-0@lo:400:kworker.0 Request processed in 55us (1512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438202.171355:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789438202.171369:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789438202.171376:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f419a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769692544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438202.171403:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f419a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769692544:12345-0@lo:400:kworker.0 Request processed in 28us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438202.171409:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789438202.171465:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769692544:0@lo:400:kworker.0 00000100:00100000:0.0:1789438202.171477:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3121500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769692416:0@lo:400:kworker.0 00000100:00080000:1.0:1789438202.171962:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789438202.171968:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789438202.171971:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789438202.171993:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769692288:0@lo:400:kworker.0 00010000:00080000:1.0:1789438202.172009:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991c3120000 x1876361769692672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789438202.172030:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769692672:0@lo:400:kworker.0 00000100:00100000:2.0:1789438202.679754:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789438202.679795:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3121500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769693056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789438202.679887:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438202.680082:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769693056 00000100:00100000:1.0:1789438202.680091:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769693056 00000100:00100000:1.0:1789438202.680149:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789438202.680160:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769693056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789438202.680192:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789438202.680243:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769693056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438202.680251:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1789438202.680300:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991c3121500 x1876361769693056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789438202.680320:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3121500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769693056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789438202.681670:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789438202.681686:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769693184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789438202.681796:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438202.681844:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769693184 00000100:00100000:1.0:1789438202.681850:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769693184 00000100:00100000:1.0:1789438202.681887:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789438202.681895:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff9e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769693184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789438202.681920:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789438202.681959:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff9e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769693184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438202.681966:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1789438202.681995:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991fa645500 x1876361769693184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789438202.682010:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769693184:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1789438202.715058:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c1969457-1646-49ba-87ff-a507cb42c3bf 00010000:00010000:3.0:1789438202.746808:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438203.767277:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789438203.824684:0:10302:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg609-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1789438204.376455:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438204.376490:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438204.376547:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438204.376697:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749737600 00000100:00100000:2.0:1789438204.376733:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749737600 00000100:00100000:2.0:1789438204.376805:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 37 00000100:00100000:2.0:1789438204.376816:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2353:x1876361749737600:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789438204.376884:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2353:x1876361749737600:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 70us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438204.376902:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 37 00000100:00100000:2.0:1789438204.376925:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749737216 00000100:00100000:2.0:1789438204.376929:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749737216 00000100:00100000:2.0:1789438204.376952:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 220 00000100:00100000:2.0:1789438204.376958:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+13:2353:x1876361749737216:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789438204.376985:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+13:2353:x1876361749737216:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 27us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438204.376991:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 220 00000100:00080000:1.0:1789438204.377471:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789438204.377546:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749737344 00000100:00100000:0.0:1789438204.377552:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749737344 00000100:00100000:0.0:1789438204.377609:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 67 00000100:00100000:0.0:1789438204.377617:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff9e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+6:2353:x1876361749737344:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789438204.377659:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff9e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+6:2353:x1876361749737344:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 43us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438204.377666:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 67 00000100:00080000:1.0:1789438204.377878:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789438204.384507:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438204.384622:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438204.385471:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749737728 00000100:00100000:3.0:1789438204.385481:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749737728 00000100:00100000:3.0:1789438204.385558:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 38 00000100:00100000:3.0:1789438204.385568:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2353:x1876361749737728:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438204.385636:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2353:x1876361749737728:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 70us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438204.385643:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 38 00000100:00080000:1.0:1789438204.387480:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789438204.392323:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749737472 00000100:00100000:0.0:1789438204.392348:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749737472 00000100:00100000:0.0:1789438204.392431:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 68 00000100:00100000:0.0:1789438204.392442:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2353:x1876361749737472:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789438204.392524:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2353:x1876361749737472:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 84us (8025us total) trans 0 rc 0/0 00000100:00080000:1.0:1789438204.392623:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789438204.393568:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 68 00010000:00010000:1.0:1789438204.794396:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438205.815860:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438206.841841:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438207.291358:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3121500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876361769693568:0@lo:400:kworker.0 00000100:00100000:3.0:1789438207.291371:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3121c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769693440:0@lo:400:kworker.0 00000100:00100000:1.0:1789438207.291464:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769693312:0@lo:400:kworker.0 00000100:00100000:2.0:1789438207.291541:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769693696:0@lo:400:kworker.0 00000100:00100000:3.0:1789438207.291697:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438207.291771:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769693952:0@lo:400:kworker.0 00000100:00100000:3.0:1789438207.291799:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438207.291843:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769693440 00000100:00100000:3.0:1789438207.291859:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769693440 00000100:00100000:3.0:1789438207.291902:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789438207.291910:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769693440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438207.291959:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769693440:12345-0@lo:400:kworker.0 Request processed in 49us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438207.291966:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789438207.291988:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769693952 00000100:00100000:3.0:1789438207.291991:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769693952 00000100:00100000:3.0:1789438207.292685:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789438207.292694:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769693952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438207.292756:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769693952:12345-0@lo:400:kworker.0 Request processed in 64us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438207.292763:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1789438207.292785:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789438207.292817:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3121c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769693440:0@lo:400:kworker.0 00010000:00080000:3.0:1789438207.292831:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991c3123b80 x1876361769693952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438207.292842:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769693952:0@lo:400:kworker.0 00000100:00100000:1.0:1789438207.296817:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438207.296895:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1876361769693824:0@lo:400:kworker.0 00000100:00100000:1.0:1789438207.296941:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438207.297008:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769693824 00000100:00100000:1.0:1789438207.297018:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769693824 00000100:00100000:3.0:1789438207.297050:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769693312 00000100:00100000:3.0:1789438207.297057:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769693312 00000100:00100000:1.0:1789438207.297089:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789438207.297103:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789438207.297104:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff9e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876361769693824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438207.297115:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3312:x1876361769693312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438207.297184:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff9e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876361769693824:12345-0@lo:400:kworker.0 Request processed in 85us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438207.297186:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3312:x1876361769693312:12345-0@lo:400:kworker.0 Request processed in 74us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438207.297200:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789438207.297201:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00080000:1.0:1789438207.297228:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789438207.297258:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769693312:0@lo:400:kworker.0 00000100:00100000:1.0:1789438207.297274:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1876361769693824:0@lo:400:kworker.0 00000100:00100000:0.0:1789438207.300912:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438207.301128:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769693568 00000100:00100000:3.0:1789438207.301151:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769693568 00000100:00100000:3.0:1789438207.301221:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789438207.301231:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876361769693568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438207.301292:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876361769693568:12345-0@lo:400:kworker.0 Request processed in 64us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438207.301299:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1789438207.301415:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789438207.301485:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3121500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876361769693568:0@lo:400:kworker.0 00000100:00100000:2.0:1789438207.304232:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438207.306980:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769693696 00000100:00100000:3.0:1789438207.306995:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769693696 00000100:00100000:3.0:1789438207.307230:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789438207.307240:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769693696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438207.307386:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769693696:12345-0@lo:400:kworker.0 Request processed in 147us (3160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438207.307394:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1789438207.309236:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789438207.309768:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991c3120000 x1876361769693696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438207.309785:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769693696:0@lo:400:kworker.0 00000100:00100000:3.0:1789438207.798958:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff9e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769694080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789438207.799053:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438207.799204:0:10069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769694080 00000100:00100000:1.0:1789438207.799214:0:10069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769694080 00000100:00100000:1.0:1789438207.799286:0:10069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789438207.799298:0:10069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769694080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789438207.799357:0:10069:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789438207.799427:0:10069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769694080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438207.799434:0:10069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1789438207.799738:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff9e6680 x1876361769694080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438207.799761:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff9e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769694080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789438207.799927:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789438207.799940:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769694208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789438207.799981:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438207.800018:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769694208 00000100:00100000:0.0:1789438207.800022:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769694208 00000100:00100000:0.0:1789438207.800054:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789438207.800062:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769694208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789438207.800089:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438207.800125:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769694208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438207.800131:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1789438207.800169:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991c3120000 x1876361769694208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438207.800195:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769694208:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789438207.868608:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438208.888445:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438209.498682:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438209.498975:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749737856 00000100:00100000:3.0:1789438209.498989:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749737856 00000100:00100000:1.0:1789438209.499119:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438209.499210:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438209.499237:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749737984 00000100:00100000:1.0:1789438209.499241:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749737984 00000100:00100000:1.0:1789438209.499298:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 72 00000100:00100000:1.0:1789438209.499310:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+6:2356:x1876361749737984:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438209.499415:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+6:2356:x1876361749737984:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 107us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438209.499422:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 72 00000100:00100000:1.0:1789438209.499450:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749738240 00000100:00100000:1.0:1789438209.499454:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749738240 00000100:00100000:1.0:1789438209.499486:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 41 00000100:00100000:1.0:1789438209.499494:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff9e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2356:x1876361749738240:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438209.499524:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff9e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2356:x1876361749738240:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 31us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438209.499530:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 41 00000100:00080000:1.0:1789438209.499547:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789438209.499552:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789438209.501692:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 222 00000100:00100000:3.0:1789438209.501736:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+13:2355:x1876361749737856:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438209.501828:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+13:2355:x1876361749737856:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 121us (3161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438209.501836:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 222 00000100:00100000:1.0:1789438209.502004:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438209.502141:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438209.502171:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749738112 00000100:00100000:1.0:1789438209.502181:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749738112 00000100:00100000:1.0:1789438209.502237:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 73 00000100:00100000:1.0:1789438209.502245:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2355:x1876361749738112:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438209.502289:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2355:x1876361749738112:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 45us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438209.502311:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 73 00000100:00100000:1.0:1789438209.502335:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749738368 00000100:00100000:1.0:1789438209.502339:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749738368 00000100:00100000:1.0:1789438209.502370:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 42 00000100:00100000:1.0:1789438209.502377:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f400b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2355:x1876361749738368:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438209.502422:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f400b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2355:x1876361749738368:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 45us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438209.502428:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 42 00000100:00080000:1.0:1789438209.502627:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789438209.502633:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789438209.913216:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438210.935037:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438211.960544:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438212.413848:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769694720:0@lo:400:kworker.0 00000100:00100000:1.0:1789438212.413937:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438212.414007:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789438212.414014:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff9e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769694336:0@lo:400:kworker.0 00000100:00100000:1.0:1789438212.414046:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438212.414072:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff9e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769694848:0@lo:400:kworker.0 00000100:00100000:1.0:1789438212.414098:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438212.414126:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff9e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769694464:0@lo:400:kworker.0 00000100:00100000:1.0:1789438212.414150:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438212.414167:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff9e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769694976:0@lo:400:kworker.0 00000100:00100000:1.0:1789438212.414186:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438212.414204:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789438212.414209:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff9e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769694592:0@lo:400:kworker.0 00000100:00100000:1.0:1789438212.414229:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438212.414273:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769694720 00000100:00100000:1.0:1789438212.414283:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769694720 00000100:00100000:1.0:1789438212.414341:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769694976 00000100:00100000:1.0:1789438212.414344:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769694976 00000100:00100000:1.0:1789438212.414368:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789438212.414389:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff9e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769694720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438212.414448:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff9e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769694720:12345-0@lo:400:kworker.0 Request processed in 60us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438212.414455:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789438212.414477:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789438212.414483:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff9e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769694976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438212.414513:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff9e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769694976:12345-0@lo:400:kworker.0 Request processed in 30us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438212.414519:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789438212.414539:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769694336 00000100:00100000:1.0:1789438212.414542:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769694336 00000100:00100000:1.0:1789438212.414569:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789438212.414575:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3311:x1876361769694336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438212.414604:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3311:x1876361769694336:12345-0@lo:400:kworker.0 Request processed in 29us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438212.414610:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789438212.414637:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769694848 00000100:00100000:1.0:1789438212.414640:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769694848 00000100:00100000:1.0:1789438212.414666:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769694464 00000100:00100000:1.0:1789438212.414668:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769694464 00000100:00100000:1.0:1789438212.414680:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769694592 00000100:00100000:1.0:1789438212.414682:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769694592 00000100:00100000:1.0:1789438212.414696:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789438212.414702:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff9e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769694848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438212.414761:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff9e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769694848:12345-0@lo:400:kworker.0 Request processed in 59us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438212.414768:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789438212.414779:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789438212.414784:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769694464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438212.414809:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769694464:12345-0@lo:400:kworker.0 Request processed in 25us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438212.414815:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789438212.414827:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789438212.414832:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff9e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769694592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438212.414859:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff9e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769694592:12345-0@lo:400:kworker.0 Request processed in 27us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438212.414866:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1789438212.414899:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789438212.414905:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789438212.414907:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789438212.414961:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff9e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769694592:0@lo:400:kworker.0 00000100:00100000:1.0:1789438212.414973:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff9e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769694464:0@lo:400:kworker.0 00010000:00080000:1.0:1789438212.414987:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff9e4e00 x1876361769694976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789438212.414998:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff9e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769694976:0@lo:400:kworker.0 00000100:00100000:1.0:1789438212.415031:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff9e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769694336:0@lo:400:kworker.0 00000100:00100000:1.0:1789438212.415041:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff9e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769694848:0@lo:400:kworker.0 00010000:00080000:1.0:1789438212.415064:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff9e7480 x1876361769694720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789438212.415073:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769694720:0@lo:400:kworker.0 00000100:00100000:1.0:1789438212.923546:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769695104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789438212.923568:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff98c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769695232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789438212.928805:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438212.929318:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769695232 00000100:00100000:2.0:1789438212.929330:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769695232 00000100:00100000:2.0:1789438212.929407:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789438212.929420:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769695232:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789438212.929611:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1789438212.929626:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789438212.929691:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769695232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 274us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438212.929699:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789438212.929745:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769695104 00000100:00100000:2.0:1789438212.929749:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769695104 00010000:00080000:1.0:1789438212.929749:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff98c000 x1876361769695232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789438212.929772:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff98c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769695232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789438212.929777:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789438212.929781:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff9e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769695104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789438212.929802:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789438212.929833:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff9e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769695104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (222us total) trans 0 rc 0/0 00010000:00080000:0.0:1789438212.929935:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff9e7480 x1876361769695104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438212.929947:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789438212.929951:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769695104:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789438212.990921:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438214.011418:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438214.624603:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438214.626570:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438214.626610:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438214.626644:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438214.626752:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749738880 00000100:00100000:0.0:1789438214.626766:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749738880 00000100:00100000:0.0:1789438214.626849:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 45 00000100:00100000:0.0:1789438214.626866:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2355:x1876361749738880:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789438214.626960:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2355:x1876361749738880:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 101us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438214.626969:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 45 00000100:00080000:0.0:1789438214.627241:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789438214.627254:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749738496 00000100:00100000:0.0:1789438214.627257:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749738496 00000100:00100000:0.0:1789438214.627287:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 224 00000100:00100000:0.0:1789438214.627305:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+13:2355:x1876361749738496:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789438214.627351:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+13:2355:x1876361749738496:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 48us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438214.627358:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 224 00000100:00100000:1.0:1789438214.630471:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438214.630609:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749739008 00000100:00100000:1.0:1789438214.630621:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749739008 00000100:00100000:1.0:1789438214.630701:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 46 00000100:00100000:1.0:1789438214.630741:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff9e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2355:x1876361749739008:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438214.630822:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff9e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2355:x1876361749739008:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 84us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438214.630830:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 46 00000100:00080000:1.0:1789438214.630883:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789438214.631057:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749738624 00000100:00100000:2.0:1789438214.631063:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749738624 00000100:00100000:2.0:1789438214.631107:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749738752 00000100:00100000:2.0:1789438214.631110:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749738752 00000100:00100000:2.0:1789438214.631128:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 77 00000100:00100000:2.0:1789438214.631134:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+6:2355:x1876361749738624:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789438214.631169:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+6:2355:x1876361749738624:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 36us (6582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438214.631176:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 77 00000100:00100000:2.0:1789438214.631189:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 78 00000100:00100000:2.0:1789438214.631194:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2355:x1876361749738752:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789438214.631212:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2355:x1876361749738752:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 18us (4568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438214.631217:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 78 00000100:00080000:1.0:1789438214.634566:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789438215.033755:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438216.054970:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438217.079471:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438217.542565:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff98ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769695360:0@lo:400:kworker.0 00000100:00100000:0.0:1789438217.542633:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438217.543138:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769695360 00000100:00100000:1.0:1789438217.543148:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769695360 00000100:00100000:1.0:1789438217.543203:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789438217.543220:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3312:x1876361769695360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438217.543422:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769695744:0@lo:400:kworker.0 00000100:00100000:2.0:1789438217.543456:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438217.543690:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3312:x1876361769695360:12345-0@lo:400:kworker.0 Request processed in 471us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438217.543698:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789438217.543810:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff98f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769695488:0@lo:400:kworker.0 00000100:00100000:2.0:1789438217.543843:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438217.543872:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789438217.543878:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff98c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769695616:0@lo:400:kworker.0 00000100:00100000:2.0:1789438217.543898:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438217.543957:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769695488 00000100:00100000:2.0:1789438217.543962:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769695488 00000100:00100000:2.0:1789438217.543985:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769695616 00000100:00100000:2.0:1789438217.543988:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769695616 00000100:00100000:2.0:1789438217.544009:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789438217.544015:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769695488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438217.544051:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769695488:12345-0@lo:400:kworker.0 Request processed in 36us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438217.544056:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789438217.544069:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789438217.544075:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769695616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438217.544100:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769695616:12345-0@lo:400:kworker.0 Request processed in 26us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438217.544107:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789438217.544889:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff98c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769695616:0@lo:400:kworker.0 00000100:00100000:2.0:1789438217.544902:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff98f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769695488:0@lo:400:kworker.0 00000100:00080000:1.0:1789438217.545471:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789438217.545542:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff98ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769695360:0@lo:400:kworker.0 00000100:00100000:0.0:1789438217.545574:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769695744 00000100:00100000:0.0:1789438217.545579:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769695744 00000100:00100000:0.0:1789438217.545629:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789438217.545639:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769695744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438217.545699:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769695744:12345-0@lo:400:kworker.0 Request processed in 64us (2242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438217.545723:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1789438217.545755:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991c7e8d180 x1876361769695744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438217.545766:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769695744:0@lo:400:kworker.0 00000100:00080000:1.0:1789438217.545827:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789438217.545945:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789438217.545994:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789438217.546005:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769696000:0@lo:400:kworker.0 00000100:00100000:3.0:1789438217.546041:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438217.548002:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769696000 00000100:00100000:0.0:1789438217.548015:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769696000 00000100:00100000:0.0:1789438217.548067:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789438217.548078:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769696000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438217.548157:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769696000:12345-0@lo:400:kworker.0 Request processed in 82us (2116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438217.548164:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1789438217.548201:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991c7e8d500 x1876361769696000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438217.548215:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769696000:0@lo:400:kworker.0 00000100:00080000:0.0:1789438217.550802:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789438217.551439:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769695872:0@lo:400:kworker.0 00000100:00100000:1.0:1789438217.551505:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438217.555848:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769695872 00000100:00100000:3.0:1789438217.555863:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769695872 00000100:00100000:3.0:1789438217.556596:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789438217.556607:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff9e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769695872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438217.556700:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff9e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769695872:12345-0@lo:400:kworker.0 Request processed in 95us (5194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438217.556730:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789438217.556842:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769695872:0@lo:400:kworker.0 00000100:00080000:0.0:1789438217.561025:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789438218.039146:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789438218.039167:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769696128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789438218.039375:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438218.039468:0:10069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769696128 00000100:00100000:0.0:1789438218.039564:0:10069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769696128 00000100:00100000:0.0:1789438218.039620:0:10069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789438218.039641:0:10069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769696128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789438218.039675:0:10069:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438218.039858:0:10069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769696128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 219us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438218.039865:0:10069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1789438218.039968:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991d06b0a80 x1876361769696128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438218.039987:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769696128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789438218.047421:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789438218.047444:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769696256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789438218.047519:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438218.047571:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769696256 00000100:00100000:0.0:1789438218.047578:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769696256 00000100:00100000:0.0:1789438218.047623:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789438218.047632:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769696256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789438218.047665:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438218.047727:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769696256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438218.047734:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1789438218.047773:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991c3120000 x1876361769696256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438218.047793:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769696256:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789438218.102872:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438219.127092:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438219.736882:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438219.736979:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438219.737012:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438219.737039:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438219.737066:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438219.737102:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749739520 00000100:00100000:1.0:1789438219.737112:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749739520 00000100:00100000:1.0:1789438219.737164:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749739648 00000100:00100000:1.0:1789438219.737167:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749739648 00000100:00100000:1.0:1789438219.737190:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 14 00000100:00100000:1.0:1789438219.737200:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2352:x1876361749739520:12345-192.168.206.9@tcp:9:kworker.0 00000020:00000080:1.0:1789438219.737230:0:6681:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924d97 00000100:00080000:1.0:1789438219.737240:0:6681:0:(import.c:65:import_set_state_nolock()) ffff9991fa75b800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789438219.737463:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749739392 00000100:00100000:3.0:1789438219.737467:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749739392 00000100:00100000:3.0:1789438219.737500:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749739264 00000100:00100000:3.0:1789438219.737503:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749739264 00000100:00100000:3.0:1789438219.737525:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 82 00000100:00100000:3.0:1789438219.737533:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff9e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2355:x1876361749739392:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438219.737595:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff9e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2355:x1876361749739392:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 63us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438219.737603:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 82 00000100:00100000:3.0:1789438219.737618:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 83 00000100:00100000:3.0:1789438219.737625:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+6:2355:x1876361749739264:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438219.737649:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+6:2355:x1876361749739264:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 24us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438219.737656:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 83 00000100:00100000:3.0:1789438219.737747:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:3.0:1789438219.737769:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2352:x1876361749739648:12345-192.168.206.9@tcp:9:kworker.0 00000020:00000080:3.0:1789438219.737782:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924d9e 00000100:00080000:3.0:1789438219.737789:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9990c2517800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789438219.737820:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789438219.738121:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1969457-1646-49ba-87ff-a507cb42c3bf+2:2352:x1876361749739648:12345-192.168.206.9@tcp:9:kworker.0 Request processed in 353us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438219.738128:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00080000:3.0:1789438219.738149:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789438219.738153:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789438219.738155:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789438219.738164:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438219.738180:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1789438219.739304:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789438219.739605:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1969457-1646-49ba-87ff-a507cb42c3bf+2:2352:x1876361749739520:12345-192.168.206.9@tcp:9:kworker.0 Request processed in 2403us (2560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438219.739630:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 14 00000100:00100000:2.0:1789438219.742436:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749739136 00000100:00100000:2.0:1789438219.742451:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749739136 00000100:00100000:2.0:1789438219.742554:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 226 00000100:00100000:2.0:1789438219.742564:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+13:2355:x1876361749739136:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789438219.742642:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+13:2355:x1876361749739136:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 73us (5764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438219.742649:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 226 00010000:00010000:3.0:1789438220.150925:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789438220.664539:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c1969457-1646-49ba-87ff-a507cb42c3bf 00000020:00000080:3.0:1789438220.664547:0:7628:0:(genops.c:885:class_export_put()) final put ffff9990c2514800/c1969457-1646-49ba-87ff-a507cb42c3bf 00000020:00000080:3.0:1789438220.664571:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9990c2514800/c1969457-1646-49ba-87ff-a507cb42c3bf for lustre-OST0001 00000020:00000080:3.0:1789438220.664625:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9990c2517800 for lustre-OST0001 00000001:02000400:1.0:1789438220.698243:0:11002:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789438221.175616:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438222.205375:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438222.648128:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789438222.648156:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769696384:0@lo:400:kworker.0 00000100:00100000:0.0:1789438222.648246:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438222.648362:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769696512:0@lo:400:kworker.0 00000100:00100000:3.0:1789438222.648371:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769696384 00000100:00100000:3.0:1789438222.648386:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769696384 00000100:00100000:0.0:1789438222.648414:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438222.648466:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789438222.648482:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3311:x1876361769696384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438222.648509:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3121180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876361769696640:0@lo:400:kworker.0 00000100:00100000:1.0:1789438222.649782:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789438222.649800:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769696768:0@lo:400:kworker.0 00000100:00100000:0.0:1789438222.650080:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438222.650234:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789438222.650246:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769696896:0@lo:400:kworker.0 00000100:00100000:0.0:1789438222.650275:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438222.650360:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769697024:0@lo:400:kworker.0 00000100:00100000:0.0:1789438222.650386:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438222.653456:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3311:x1876361769696384:12345-0@lo:400:kworker.0 Request processed in 4963us (5195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438222.653478:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789438222.653501:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769696384:0@lo:400:kworker.0 00000100:00100000:3.0:1789438222.653565:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769696512 00000100:00100000:3.0:1789438222.653578:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769696512 00000100:00100000:0.0:1789438222.653794:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438222.654031:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769696640 00000100:00100000:3.0:1789438222.654037:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769696640 00000100:00100000:3.0:1789438222.656486:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769696896 00000100:00100000:3.0:1789438222.656500:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769696896 00000100:00100000:0.0:1789438222.658274:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789438222.658302:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769696512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438222.658417:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769696512:12345-0@lo:400:kworker.0 Request processed in 131us (10003us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438222.658426:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789438222.658457:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789438222.658466:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876361769696640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438222.658500:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876361769696640:12345-0@lo:400:kworker.0 Request processed in 36us (8423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438222.658507:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789438222.658554:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769696512:0@lo:400:kworker.0 00000100:00100000:0.0:1789438222.658588:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3121180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876361769696640:0@lo:400:kworker.0 00000100:00100000:3.0:1789438222.659499:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789438222.659515:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769696896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438222.659627:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769696896:12345-0@lo:400:kworker.0 Request processed in 116us (9351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438222.659639:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789438222.659690:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769697024 00000100:00100000:3.0:1789438222.659699:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769697024 00000100:00100000:3.0:1789438222.659751:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769696768 00000100:00100000:3.0:1789438222.659756:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769696768 00000100:00100000:3.0:1789438222.659779:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789438222.659786:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769697024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438222.659824:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769697024:12345-0@lo:400:kworker.0 Request processed in 38us (9436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438222.659831:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789438222.659841:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789438222.659847:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769696768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438222.659877:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769696768:12345-0@lo:400:kworker.0 Request processed in 30us (6088us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438222.659883:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1789438222.662094:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991c3123b80 x1876361769697024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438222.662116:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769697024:0@lo:400:kworker.0 00000100:00100000:0.0:1789438222.662179:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769696896:0@lo:400:kworker.0 00010000:00080000:0.0:1789438222.662209:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991e06f8000 x1876361769696768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438222.662219:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769696768:0@lo:400:kworker.0 00000100:00080000:1.0:1789438222.667476:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789438222.667489:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789438222.667494:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789438223.166449:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769697152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789438223.166456:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769697280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789438223.174690:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438223.175238:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769697152 00000100:00100000:2.0:1789438223.175257:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769697152 00000100:00100000:2.0:1789438223.175424:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789438223.175437:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769697152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789438223.175486:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789438223.175553:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769697152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438223.175561:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1789438223.175614:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991e06faa00 x1876361769697152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438223.175639:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769697152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789438223.176054:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438223.176555:0:10069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769697280 00000100:00100000:2.0:1789438223.176563:0:10069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769697280 00000100:00100000:2.0:1789438223.176599:0:10069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789438223.176611:0:10069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769697280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789438223.176643:0:10069:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789438223.176699:0:10069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769697280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438223.176742:0:10069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1789438223.176789:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991c3122a00 x1876361769697280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438223.176809:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769697280:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789438223.228829:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789438223.288511:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c1969457-1646-49ba-87ff-a507cb42c3bf 00000020:00000080:1.0:1789438223.288525:0:6706:0:(genops.c:885:class_export_put()) final put ffff9991fa75d800/c1969457-1646-49ba-87ff-a507cb42c3bf 00000020:00000080:3.0:1789438223.289923:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9991fa75d800/c1969457-1646-49ba-87ff-a507cb42c3bf for lustre-OST0000 00000020:00000080:3.0:1789438223.289994:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9991fa75b800 for lustre-OST0000 00010000:00010000:0.0:1789438224.265161:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789438224.552427:0:11151:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff0f57e000 20000000:00000080:3.0:1789438224.552444:0:11151:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9991fbb13000 uarg=0000000000000000 20000000:01000000:3.0:1789438224.552479:0:11151:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789438224.552490:0:11151:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789438224.552494:0:11151:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789438224.554062:0:11152:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1789438224.554209:0:11151:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789438224.563797:0:11151:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789438224.563831:0:11151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9991c2a54c00/0x7a8dd0fcbb924da5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438224.563854:0:11151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9992021c4000/0x7a8dd0fcbb924d4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0e0 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438224.563864:0:11151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9992021c5a00/0x7a8dd0fcbb924d58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924d51 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438224.563871:0:11151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991ff9dba00/0x7a8dd0fcbb924d66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924d5f expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438224.563877:0:11151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991c2a55e00/0x7a8dd0fcbb924d74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924d6d expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438224.563885:0:11151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991ff9da200/0x7a8dd0fcbb924d89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa118 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438224.563893:0:11151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9991c2a54c00/0x7a8dd0fcbb924da5 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438224.563941:0:11151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991ff9da200/0x7a8dd0fcbb924d89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa118 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438224.563959:0:11151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9991ff9da200/0x7a8dd0fcbb924d89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa118 expref: 12 pid: 5832 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438224.563975:0:11151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1876361769697408:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789438224.564085:0:11151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991c2a55e00/0x7a8dd0fcbb924d74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb924d6d expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438224.564094:0:11151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9991c2a55e00/0x7a8dd0fcbb924d74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924d6d expref: 18 pid: 5833 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438224.564103:0:11151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1876361769697536:0@lo:104: 00000100:00100000:3.0:1789438224.564143:0:11151:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789438224.564192:0:11151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991ff9dba00/0x7a8dd0fcbb924d66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb924d5f expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438224.564201:0:11151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9991ff9dba00/0x7a8dd0fcbb924d66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924d5f expref: 18 pid: 5833 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438224.564209:0:11151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1876361769697664:0@lo:104: 00000100:00100000:3.0:1789438224.564229:0:11151:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438224.564266:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769697536 00000100:00100000:3.0:1789438224.564273:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769697536 00000100:00100000:3.0:1789438224.564312:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769697664 00000100:00100000:3.0:1789438224.564328:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769697664 00000100:00100000:3.0:1789438224.564345:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789438224.564352:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7073a0da-08cf-42fe-8791-a8c6139408f2+4:11151:x1876361769697536:12345-0@lo:104: 00010000:00010000:3.0:1789438224.564365:0:6695:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924d6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924d74 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438224.564411:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789438224.564416:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7073a0da-08cf-42fe-8791-a8c6139408f2+4:11151:x1876361769697536:12345-0@lo:104: Request processed in 65us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438224.564423:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789438224.564449:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789438224.564455:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7073a0da-08cf-42fe-8791-a8c6139408f2+3:11151:x1876361769697664:12345-0@lo:104: 00010000:00010000:3.0:1789438224.564463:0:6695:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff999202045000/0x7a8dd0fcbb924d5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924d66 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438224.564492:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789438224.564497:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7073a0da-08cf-42fe-8791-a8c6139408f2+3:11151:x1876361769697664:12345-0@lo:104: Request processed in 43us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438224.564502:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1789438224.564530:0:11151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9992021c5a00/0x7a8dd0fcbb924d58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb924d51 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438224.564538:0:11151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9992021c5a00/0x7a8dd0fcbb924d58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924d51 expref: 18 pid: 5832 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438224.564546:0:11151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1876361769697792:0@lo:104: 00000100:00100000:3.0:1789438224.564566:0:11151:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438224.564585:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769697792 00000100:00100000:3.0:1789438224.564589:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769697792 00000100:00100000:3.0:1789438224.564604:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789438224.564610:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7073a0da-08cf-42fe-8791-a8c6139408f2+3:11151:x1876361769697792:12345-0@lo:104: 00010000:00010000:3.0:1789438224.564616:0:6695:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9992021c5600/0x7a8dd0fcbb924d51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924d58 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438224.564643:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:2.0:1789438224.564820:0:11151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9992021c4000/0x7a8dd0fcbb924d4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0e0 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438224.564830:0:11151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9992021c4000/0x7a8dd0fcbb924d4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0e0 expref: 12 pid: 5833 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438224.564840:0:11151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1876361769697920:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789438224.564874:0:11151:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c8128780 going to sleep for 11 seconds 00000100:00100000:2.0:1789438224.564896:0:11151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1876361769697536:0@lo:104: 00000100:00100000:2.0:1789438224.564904:0:11151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1876361769697664:0@lo:104: 00000100:00100000:2.0:1789438224.564910:0:11151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1876361769697792:0@lo:104: 00010000:00010000:0.0:1789438224.565246:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789438224.565254:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924d6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924d74 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.565262:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9db200 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:0.0:1789438224.565266:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924d6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb924d74 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.565275:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924d6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb924d74 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789438224.565283:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924d6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb924d74 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789438224.565289:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789438224.565325:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924d6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924d74 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.565332:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789438224.565353:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924d6d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924d74 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.565369:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924d6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924d74 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.565382:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789438224.565386:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff999202045000/0x7a8dd0fcbb924d5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924d66 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.565391:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999202045000 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:0.0:1789438224.565394:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff999202045000/0x7a8dd0fcbb924d5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb924d66 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.565400:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff999202045000/0x7a8dd0fcbb924d5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb924d66 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789438224.565405:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff999202045000/0x7a8dd0fcbb924d5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb924d66 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789438224.565410:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789438224.565424:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff999202045000/0x7a8dd0fcbb924d5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924d66 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.565429:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789438224.565446:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff999202045000/0x7a8dd0fcbb924d5f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924d66 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.565453:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff999202045000/0x7a8dd0fcbb924d5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924d66 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.565463:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789438224.565472:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9992021c5600/0x7a8dd0fcbb924d51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924d58 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.565478:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9992021c5600 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:0.0:1789438224.565480:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9992021c5600/0x7a8dd0fcbb924d51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb924d58 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.565486:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9992021c5600/0x7a8dd0fcbb924d51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb924d58 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789438224.565492:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9992021c5600/0x7a8dd0fcbb924d51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb924d58 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789438224.565497:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789438224.565512:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9992021c5600/0x7a8dd0fcbb924d51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924d58 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.565517:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789438224.565523:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9992021c5600/0x7a8dd0fcbb924d51 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924d58 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.565529:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9992021c5600/0x7a8dd0fcbb924d51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924d58 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.565543:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438224.565545:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438224.565546:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438224.565559:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3121180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769698048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789438224.565598:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438224.565634:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769698176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789438224.565679:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438224.565700:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789438224.565723:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769698304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789438224.565745:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438224.565775:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769698048 00000100:00100000:0.0:1789438224.565779:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769698048 00010000:00010000:0.0:1789438224.565809:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991c2a55e00/0x7a8dd0fcbb924d74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924d6d expref: 19 pid: 5833 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438224.565831:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769698176 00000100:00100000:0.0:1789438224.565834:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769698176 00010000:00010000:0.0:1789438224.565846:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991ff9dba00/0x7a8dd0fcbb924d66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924d5f expref: 20 pid: 5833 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438224.565857:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769698304 00000100:00100000:0.0:1789438224.565861:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769698304 00010000:00010000:0.0:1789438224.565871:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9992021c5a00/0x7a8dd0fcbb924d58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924d51 expref: 21 pid: 5832 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438224.565885:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789438224.565892:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d0513850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+21:3312:x1876361769698048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789438224.565902:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438224.565907:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991c2a55e00/0x7a8dd0fcbb924d74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924d6d expref: 21 pid: 5833 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.565917:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991c2a55e00/0x7a8dd0fcbb924d74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924d6d expref: 21 pid: 5833 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.565929:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c2a55e00/0x7a8dd0fcbb924d74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb924d6d expref: 21 pid: 5833 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.565952:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438224.565984:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d0513850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+20:3312:x1876361769698048:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438224.565991:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789438224.566032:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789438224.566040:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa74a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3309:x1876361769698176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789438224.566047:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438224.566052:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991ff9dba00/0x7a8dd0fcbb924d66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924d5f expref: 19 pid: 5833 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.566059:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991ff9dba00/0x7a8dd0fcbb924d66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924d5f expref: 19 pid: 5833 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.566069:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991ff9dba00/0x7a8dd0fcbb924d66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb924d5f expref: 19 pid: 5833 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.566079:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438224.566106:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa74a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+18:3309:x1876361769698176:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438224.566112:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789438224.566125:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789438224.566130:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa749f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+17:3309:x1876361769698304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789438224.566137:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438224.566142:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9992021c5a00/0x7a8dd0fcbb924d58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924d51 expref: 17 pid: 5832 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.566149:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9992021c5a00/0x7a8dd0fcbb924d58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924d51 expref: 17 pid: 5832 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.566165:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9992021c5a00/0x7a8dd0fcbb924d58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb924d51 expref: 17 pid: 5832 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.566174:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438224.566197:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa749f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+16:3309:x1876361769698304:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438224.566204:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789438224.566246:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3121180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769698048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789438224.566271:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769698304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789438224.566278:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769698176:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789438224.566917:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438224.570898:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7073a0da-08cf-42fe-8791-a8c6139408f2+3:11151:x1876361769697792:12345-0@lo:104: Request processed in 38us (80us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438224.570914:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789438224.571257:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438224.571345:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438224.571376:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749739776 00000100:00100000:0.0:1789438224.571385:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749739776 00010000:00010000:0.0:1789438224.571421:0:8438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991ff9da200/0x7a8dd0fcbb924d89 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa118 expref: 13 pid: 5832 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438224.571446:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749739904 00000100:00100000:0.0:1789438224.571449:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749739904 00010000:00010000:0.0:1789438224.571459:0:8438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9992021c4000/0x7a8dd0fcbb924d4a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0e0 expref: 14 pid: 5833 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438224.571475:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 28 00000100:00100000:0.0:1789438224.571483:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa748700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58dec870-790c-4419-a02f-595f69c3b298+14:2354:x1876361749739776:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789438224.571496:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438224.571508:0:8438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991ff9da200/0x7a8dd0fcbb924d89 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa118 expref: 14 pid: 5832 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.571533:0:8438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991ff9da200/0x7a8dd0fcbb924d89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa118 expref: 14 pid: 5832 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.571555:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438224.571606:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa748700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58dec870-790c-4419-a02f-595f69c3b298+14:2354:x1876361749739776:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 124us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438224.571613:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 28 00000100:00100000:0.0:1789438224.571628:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 29 00000100:00100000:0.0:1789438224.571635:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa74ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58dec870-790c-4419-a02f-595f69c3b298+13:2354:x1876361749739904:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789438224.571643:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438224.571648:0:8438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9992021c4000/0x7a8dd0fcbb924d4a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0e0 expref: 13 pid: 5833 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.571658:0:8438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9992021c4000/0x7a8dd0fcbb924d4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0e0 expref: 13 pid: 5833 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.571671:0:8438:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9991c2a54c00/0x7a8dd0fcbb924da5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.571681:0:8438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c2a54c00/0x7a8dd0fcbb924da5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.571696:0:8438:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9991c2a54c00/0x7a8dd0fcbb924da5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.571704:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9991c2a54c00/0x7a8dd0fcbb924da5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.571729:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9991c2a54c00/0x7a8dd0fcbb924da5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.571741:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9991c2a54c00/0x7a8dd0fcbb924da5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.571747:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54c00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:0.0:1789438224.571751:0:8438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9991c2a54c00/0x7a8dd0fcbb924da5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.571761:0:8438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9991c2a54c00/0x7a8dd0fcbb924da5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.571770:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9991c2a54c00/0x7a8dd0fcbb924da5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438224.571780:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438224.571803:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa74ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58dec870-790c-4419-a02f-595f69c3b298+13:2354:x1876361749739904:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 168us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438224.571810:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 29 00010000:00010000:3.0:1789438224.573401:0:11151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991ff9da200/0x7a8dd0fcbb924d89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa118 expref: 12 pid: 5832 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438224.573434:0:11151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1876361769697408:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789438224.573451:0:11151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9992021c4000/0x7a8dd0fcbb924d4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0e0 expref: 11 pid: 5833 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438224.573460:0:11151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1876361769697920:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789438224.573491:0:11151:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9991c2a54c00/0x7a8dd0fcbb924da5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438224.573500:0:11151:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9991c2a54c00/0x7a8dd0fcbb924da5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438224.573506:0:11151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9991c2a54c00/0x7a8dd0fcbb924da5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438224.573512:0:11151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c2a54c00/0x7a8dd0fcbb924da5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438224.858879:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438224.858924:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438224.859273:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749740032 00000100:00100000:3.0:1789438224.859284:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749740032 00000100:00100000:3.0:1789438224.859365:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749740160 00000100:00100000:3.0:1789438224.859369:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749740160 00000100:00100000:3.0:1789438224.859395:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 87 00000100:00100000:3.0:1789438224.859405:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa74b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+6:2356:x1876361749740032:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438224.859481:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa74b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+6:2356:x1876361749740032:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 78us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438224.859488:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 87 00000100:00100000:3.0:1789438224.859505:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 88 00000100:00100000:3.0:1789438224.859523:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2356:x1876361749740160:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438224.859547:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2356:x1876361749740160:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 25us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438224.859553:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 88 00000100:00080000:0.0:1789438224.860339:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789438225.270879:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438226.072785:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438226.072900:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749740288 00000100:00100000:2.0:1789438226.072911:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749740288 00000100:00100000:2.0:1789438226.072972:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 228 00000100:00100000:2.0:1789438226.072982:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+11:5595:x1876361749740288:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789438226.072999:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438226.073018:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff999202045600/0x7a8dd0fcbb924dac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x483b483084eaa142 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438226.073047:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff999202045600/0x7a8dd0fcbb924dac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa142 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438226.073076:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff999202045600/0x7a8dd0fcbb924dac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa142 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438226.073085:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999202045600, rc 0) 00000100:00100000:2.0:1789438226.073156:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+12:5595:x1876361749740288:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 Request processed in 175us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438226.073164:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 228 00000100:00100000:0.0:1789438226.078233:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438226.080526:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749740416 00000100:00100000:1.0:1789438226.080539:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749740416 00000100:00100000:1.0:1789438226.080595:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 229 00000100:00100000:1.0:1789438226.080605:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+12:5595:x1876361749740416:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789438226.080898:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+12:5595:x1876361749740416:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 Request processed in 292us (2672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438226.080906:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 229 00000100:00100000:1.0:1789438226.088513:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438226.088663:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749740544 00000100:00100000:3.0:1789438226.088673:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749740544 00000100:00100000:1.0:1789438226.089052:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 230 00000100:00100000:1.0:1789438226.089063:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+12:5595:x1876361749740544:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789438226.089320:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+12:5595:x1876361749740544:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 Request processed in 249us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438226.089335:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 230 00000100:00100000:2.0:1789438226.098269:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438226.100075:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749740672 00000100:00100000:1.0:1789438226.100088:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749740672 00000100:00100000:1.0:1789438226.100151:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 231 00000100:00100000:1.0:1789438226.100162:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+12:5595:x1876361749740672:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789438226.100178:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438226.100196:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991ff9dbe00/0x7a8dd0fcbb924db3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x483b483084eaa149 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438226.100225:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991ff9dbe00/0x7a8dd0fcbb924db3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa149 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438226.100236:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991ff9dbe00/0x7a8dd0fcbb924db3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa149 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438226.100245:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9dbe00, rc 0) 00000100:00100000:1.0:1789438226.100321:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+13:5595:x1876361749740672:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 Request processed in 161us (2060us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438226.100330:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 231 00000100:00100000:3.0:1789438226.103885:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438226.105282:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749740800 00000100:00100000:2.0:1789438226.105296:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749740800 00000100:00100000:2.0:1789438226.105357:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 232 00000100:00100000:2.0:1789438226.105368:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+13:5595:x1876361749740800:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789438226.105651:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+13:5595:x1876361749740800:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 Request processed in 284us (1774us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438226.105658:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 232 00000100:00100000:1.0:1789438226.113410:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438226.113475:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749740928 00000100:00100000:3.0:1789438226.113486:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749740928 00000100:00100000:3.0:1789438226.113631:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 233 00000100:00100000:3.0:1789438226.113643:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+13:5595:x1876361749740928:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789438226.113868:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+13:5595:x1876361749740928:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 Request processed in 227us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438226.113876:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 233 00010000:00010000:1.0:1789438226.294907:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789438226.486816:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789438226.486823:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9991ffa93000 from 7 10000000:01000000:2.0:1789438226.486827:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789438226.486882:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924dba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438226.486894:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924dba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438226.486906:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924dba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438226.486946:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769698432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789438226.487015:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438226.487577:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e1f08300 going to sleep for 11 seconds 00000100:00100000:1.0:1789438226.487810:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769698432 00000100:00100000:1.0:1789438226.487820:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769698432 00000100:00100000:1.0:1789438226.487914:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789438226.487925:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+16:5836:x1876361769698432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789438226.487939:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438226.487955:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991ff9da200/0x7a8dd0fcbb924dc1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924dba expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438226.487990:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991ff9da200/0x7a8dd0fcbb924dc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924dba expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438226.488000:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991ff9da200/0x7a8dd0fcbb924dc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924dba expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438226.488008:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9da200, rc 0) 00000100:00100000:1.0:1789438226.488079:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+17:5836:x1876361769698432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438226.488086:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789438226.488177:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769698432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789438226.488194:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924dba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924dc1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438226.488203:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924dba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924dc1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438226.488297:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa748e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769698560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789438226.488339:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438226.488639:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d9df4240 going to sleep for 11 seconds 00000100:00100000:2.0:1789438226.488698:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769698560 00000100:00100000:2.0:1789438226.488703:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769698560 00000100:00100000:2.0:1789438226.488751:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789438226.488759:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+17:5836:x1876361769698560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789438226.488989:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+17:5836:x1876361769698560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438226.488997:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789438226.489330:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa748e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769698560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789438226.489375:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769698688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789438226.489418:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438226.489443:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e1f08c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789438226.489457:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769698688 00000100:00100000:2.0:1789438226.489462:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769698688 00000100:00100000:2.0:1789438226.489481:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789438226.489487:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+17:5836:x1876361769698688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789438226.489627:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+17:5836:x1876361769698688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438226.489635:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789438226.489673:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769698688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789438226.490763:0:11207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789438226.490909:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789438226.490935:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789438226.490946:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924dba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924dc1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438226.490957:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924dba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924dc1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789438226.490968:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789438226.490970:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9991d08f6800 from 7 10000000:01000000:1.0:1789438226.490974:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789438226.491010:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9dba00/0x7a8dd0fcbb924dc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438226.491018:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991ff9dba00/0x7a8dd0fcbb924dc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438226.491029:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991ff9dba00/0x7a8dd0fcbb924dc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438226.491076:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769698816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789438226.491140:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438226.491176:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fa9ea0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789438226.491480:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769698816 00000100:00100000:2.0:1789438226.491495:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769698816 00000100:00100000:2.0:1789438226.491539:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789438226.491548:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+17:5836:x1876361769698816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789438226.491559:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438226.491570:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff999202044800/0x7a8dd0fcbb924dcf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924dc8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438226.491591:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff999202044800/0x7a8dd0fcbb924dcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924dc8 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438226.491602:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff999202044800/0x7a8dd0fcbb924dcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924dc8 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438226.491611:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999202044800, rc 0) 00000100:00100000:2.0:1789438226.491651:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769698816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438226.491658:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789438226.491698:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769698816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789438226.491734:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991ff9dba00/0x7a8dd0fcbb924dc8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924dcf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438226.491744:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991ff9dba00/0x7a8dd0fcbb924dc8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924dcf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438226.491795:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769698944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789438226.491822:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438226.491836:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e1f08240 going to sleep for 11 seconds 00000100:00100000:2.0:1789438226.491848:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769698944 00000100:00100000:2.0:1789438226.491857:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769698944 00000100:00100000:2.0:1789438226.491877:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789438226.491882:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769698944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789438226.492112:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769698944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 228us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438226.492120:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789438226.492340:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769698944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789438226.492370:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769699072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789438226.492407:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438226.492421:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e1f08240 going to sleep for 11 seconds 00000100:00100000:2.0:1789438226.492433:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769699072 00000100:00100000:2.0:1789438226.492437:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769699072 00000100:00100000:2.0:1789438226.492455:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789438226.492461:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769699072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789438226.492589:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769699072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438226.492597:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789438226.492632:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769699072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789438226.493598:0:11208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789438226.495543:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789438226.495575:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789438226.495586:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9dba00/0x7a8dd0fcbb924dc8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924dcf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438226.495598:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991ff9dba00/0x7a8dd0fcbb924dc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924dcf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789438226.495609:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789438226.495611:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9991d197a000 from 7 10000000:01000000:1.0:1789438226.495613:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789438226.495652:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924dd6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438226.495660:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924dd6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438226.495670:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924dd6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438226.495692:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769699200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789438226.495765:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438226.495798:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fa9ea6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789438226.495868:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769699200 00000100:00100000:2.0:1789438226.495876:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769699200 00000100:00100000:2.0:1789438226.495923:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789438226.495934:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769699200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789438226.495948:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438226.495962:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff999202045000/0x7a8dd0fcbb924ddd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924dd6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438226.496000:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff999202045000/0x7a8dd0fcbb924ddd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924dd6 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438226.496011:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff999202045000/0x7a8dd0fcbb924ddd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924dd6 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438226.496025:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff999202045000, rc 0) 00000100:00100000:2.0:1789438226.496704:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+19:5836:x1876361769699200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 770us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438226.496739:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789438226.496865:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769699200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789438226.496884:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924dd6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924ddd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438226.496904:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924dd6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924ddd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438226.496972:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769699328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789438226.497001:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438226.497348:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fa9ea6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789438226.497384:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769699328 00000100:00100000:0.0:1789438226.497392:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769699328 00000100:00100000:0.0:1789438226.497461:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789438226.497471:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:5836:x1876361769699328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789438226.497829:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:5836:x1876361769699328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 360us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438226.497837:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789438226.498224:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769699328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789438226.498271:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769699456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789438226.498322:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438226.498785:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d04d4180 going to sleep for 11 seconds 00000100:00100000:1.0:1789438226.498882:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769699456 00000100:00100000:1.0:1789438226.498888:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769699456 00000100:00100000:1.0:1789438226.498918:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789438226.498926:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:5836:x1876361769699456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789438226.499352:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:5836:x1876361769699456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 426us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438226.499359:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789438226.499478:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769699456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789438226.501390:0:11209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789438226.501599:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789438226.501627:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789438226.501638:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924dd6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924ddd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438226.501651:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924dd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924ddd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438227.330569:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438227.769076:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa74aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769699840:0@lo:400:kworker.0 00000100:00100000:0.0:1789438227.769147:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438227.769229:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789438227.769236:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769699968:0@lo:400:kworker.0 00000100:00100000:0.0:1789438227.769262:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438227.769326:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769699840 00000100:00100000:0.0:1789438227.769335:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769699840 00000100:00100000:0.0:1789438227.769391:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789438227.769403:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769699840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438227.769448:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa74b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876361769699712:0@lo:400:kworker.0 00000100:00100000:0.0:1789438227.769452:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769699840:12345-0@lo:400:kworker.0 Request processed in 54us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438227.769459:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789438227.769476:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438227.769528:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa74b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769699584:0@lo:400:kworker.0 00000100:00100000:1.0:1789438227.769569:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769700224:0@lo:400:kworker.0 00000100:00100000:2.0:1789438227.773556:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438227.773627:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa74a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769700096:0@lo:400:kworker.0 00000100:00100000:2.0:1789438227.773677:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438227.773745:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769699712 00000100:00100000:0.0:1789438227.773755:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769699712 00000100:00100000:0.0:1789438227.773841:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789438227.773852:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876361769699712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438227.773904:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876361769699712:12345-0@lo:400:kworker.0 Request processed in 54us (4426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438227.773911:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789438227.773939:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769699968 00000100:00100000:0.0:1789438227.773943:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769699968 00000100:00100000:0.0:1789438227.773972:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789438227.773979:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa74bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769699968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438227.774007:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa74bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769699968:12345-0@lo:400:kworker.0 Request processed in 30us (4745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438227.774012:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1789438227.774026:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789438227.774030:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789438227.774069:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991fa749500 x1876361769699968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438227.774084:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769699968:0@lo:400:kworker.0 00000100:00100000:0.0:1789438227.774096:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa74aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769699840:0@lo:400:kworker.0 00000100:00100000:0.0:1789438227.774144:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769699584 00000100:00100000:0.0:1789438227.774147:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769699584 00000100:00100000:0.0:1789438227.774172:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789438227.774179:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3311:x1876361769699584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438227.774210:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3311:x1876361769699584:12345-0@lo:400:kworker.0 Request processed in 32us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438227.774226:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789438227.775367:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438227.775443:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa74b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876361769699712:0@lo:400:kworker.0 00000100:00100000:2.0:1789438227.775562:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa74b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769699584:0@lo:400:kworker.0 00000100:00100000:1.0:1789438227.775734:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769700096 00000100:00100000:1.0:1789438227.775741:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769700096 00000100:00100000:1.0:1789438227.775785:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789438227.775792:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769700096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438227.775840:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769700096:12345-0@lo:400:kworker.0 Request processed in 48us (2162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438227.775861:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789438227.775896:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa74a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769700096:0@lo:400:kworker.0 00000100:00080000:2.0:1789438227.775948:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789438227.780447:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769700224 00000100:00100000:0.0:1789438227.780461:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769700224 00000100:00100000:0.0:1789438227.780565:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789438227.780576:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769700224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438227.780675:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769700224:12345-0@lo:400:kworker.0 Request processed in 103us (5491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438227.780682:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1789438227.780745:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991fa748000 x1876361769700224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438227.780759:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769700224:0@lo:400:kworker.0 00000100:00080000:2.0:1789438227.781135:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789438228.279339:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f419ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769700352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789438228.279407:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438228.279547:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789438228.279557:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769700480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789438228.279585:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438228.279734:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769700352 00000100:00100000:2.0:1789438228.279743:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769700352 00000100:00100000:2.0:1789438228.279788:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769700480 00000100:00100000:2.0:1789438228.279791:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769700480 00000100:00100000:2.0:1789438228.279805:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789438228.279814:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769700352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789438228.279846:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789438228.279889:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769700352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438228.279897:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789438228.279914:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789438228.279920:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769700480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789438228.279938:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789438228.279965:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769700480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438228.279971:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1789438228.280119:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991c7e8f800 x1876361769700480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438228.280139:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769700480:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1789438228.280152:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991f419ad80 x1876361769700352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438228.280162:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f419ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769700352:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789438228.342842:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789438228.705897:0:11349:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg609-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789438229.371235:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438229.978067:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438229.978124:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438229.978168:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438229.978201:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749741184 00000100:00100000:3.0:1789438229.978211:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749741184 00000100:00100000:3.0:1789438229.978283:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749741312 00000100:00100000:3.0:1789438229.978287:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749741312 00000100:00100000:3.0:1789438229.978323:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 92 00000100:00100000:3.0:1789438229.978333:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+6:2354:x1876361749741184:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438229.978405:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+6:2354:x1876361749741184:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 73us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438229.978413:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 92 00000100:00100000:1.0:1789438229.978419:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749741056 00000100:00100000:1.0:1789438229.978426:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749741056 00000100:00100000:3.0:1789438229.978435:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 93 00000100:00100000:3.0:1789438229.978445:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2353:x1876361749741312:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438229.978471:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2353:x1876361749741312:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 28us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438229.978476:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 93 00000100:00080000:2.0:1789438229.978747:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789438229.978787:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 244 00000100:00100000:1.0:1789438229.978798:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+13:2353:x1876361749741056:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438229.979028:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+13:2353:x1876361749741056:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 230us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438229.979036:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 244 00010000:00010000:2.0:1789438230.391044:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438231.415022:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789438232.267257:0:11449:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 22:10:30 (1789438230) === 00010000:00010000:1.0:1789438232.443687:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438232.503610:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438232.503693:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438232.504005:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749741440 00000100:00100000:0.0:1789438232.504015:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749741440 00000100:00100000:0.0:1789438232.504095:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 14 00000100:00100000:0.0:1789438232.504107:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+6:2355:x1876361749741440:12345-192.168.206.9@tcp:41:mkdir.0 00000004:00000024:0.0:1789438232.504152:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789438232.504251:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+6:2355:x1876361749741440:12345-192.168.206.9@tcp:41:mkdir.0 Request processed in 147us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438232.504260:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 14 00000100:00080000:2.0:1789438232.504921:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789438232.505045:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749741568 00000100:00100000:1.0:1789438232.505053:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749741568 00000100:00100000:1.0:1789438232.505132:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00100000:1.0:1789438232.505141:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f419ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1274be99-2d57-4dac-a13e-a89426512ee0+6:9694:x1876361749741568:12345-192.168.206.9@tcp:700:mkdir.0 00000100:00100000:1.0:1789438232.505203:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f419ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1274be99-2d57-4dac-a13e-a89426512ee0+6:9694:x1876361749741568:12345-192.168.206.9@tcp:700:mkdir.0 Request processed in 62us (1509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438232.505218:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00100000:2.0:1789438232.512399:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438232.512498:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749741824 00000100:00100000:3.0:1789438232.512580:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749741824 00000100:00100000:3.0:1789438232.512685:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:3.0:1789438232.512696:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+6:9694:x1876361749741824:12345-192.168.206.9@tcp:36:mkdir.0 00010000:00010000:3.0:1789438232.512783:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438232.512853:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff999202044000/0x7a8dd0fcbb924cc5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0cb expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.512875:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872800) 00010000:00010000:3.0:1789438232.512902:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789438232.516244:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb924de4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.516268:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb924de4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.516290:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb924de4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.516339:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924deb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.516347:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924deb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.516354:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924deb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789438232.518301:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789438232.518317:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb924de4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.518328:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb924de4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.518336:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb924de4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.518342:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55200 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438232.518347:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb924de4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.518365:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb924de4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.518382:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d192ca00) 00010000:00010000:3.0:1789438232.518385:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789438232.518390:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb924de4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.518397:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb924de4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789438232.518417:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d563da67 reply state 0000000031f8ea4e transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924deb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438232.518426:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789438232.518729:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+7:9694:x1876361749741824:12345-192.168.206.9@tcp:36:mkdir.0 Request processed in 6007us (6312us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789438232.518739:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 15 00010000:00010000:3.0:1789438232.525396:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924deb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.525414:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924deb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.525423:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924deb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.525429:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54c00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438232.525433:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924deb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.525457:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924deb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.525473:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9991d192c100) 00010000:00010000:3.0:1789438232.525476:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789438232.525481:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924deb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.525487:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924deb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438232.535480:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438232.535564:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749741952 00000100:00100000:0.0:1789438232.535575:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749741952 00000100:00100000:0.0:1789438232.535638:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:0.0:1789438232.535651:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+6:9695:x1876361749741952:12345-192.168.206.9@tcp:101:chmod.0 00010000:00010000:0.0:1789438232.535671:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438232.535694:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb924df2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa150 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.535789:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb924df9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.535803:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb924df9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.535815:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb924df9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438232.535848:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789438232.535851:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789438232.535889:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb924df9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.535914:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb924df2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa150 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.535941:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb924df9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa150 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.535950:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991c3ac2100) 00010000:00010000:0.0:1789438232.535953:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789438232.535956:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d62200, rc 0) 00000100:00100000:0.0:1789438232.536129:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+7:9695:x1876361749741952:12345-192.168.206.9@tcp:101:chmod.0 Request processed in 480us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438232.536136:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:1.0:1789438232.538047:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438232.538389:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749742208 00000100:00100000:0.0:1789438232.538399:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749742208 00000100:00100000:0.0:1789438232.538478:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 17 00000100:00100000:0.0:1789438232.538489:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+7:9695:x1876361749742208:12345-192.168.206.9@tcp:36:chmod.0 00010000:00010000:0.0:1789438232.538538:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438232.538562:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb924df9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa150 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.538590:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991c3ac2100) 00010000:00010000:0.0:1789438232.538601:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789438232.538625:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb924e00 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.538638:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb924e00 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.538647:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb924e00 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789438232.538990:0:7624:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006c543bc reply state 000000001b1d6131 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb924e00 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438232.539002:0:7624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789438232.539010:0:7624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789438232.539099:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+8:9695:x1876361749742208:12345-192.168.206.9@tcp:36:chmod.0 Request processed in 611us (1058us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789438232.539107:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 17 00010000:00010000:0.0:1789438232.547934:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb924e00 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.547958:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb924e00 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.547991:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb924e00 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.548006:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438232.548011:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb924e00 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.548019:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb924e00 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.548034:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991c3ac2700) 00010000:00010000:0.0:1789438232.548036:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789438232.548041:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb924e00 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.548047:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb924e00 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438232.574421:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438232.577791:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749742336 00000100:00100000:3.0:1789438232.577809:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749742336 00000100:00100000:2.0:1789438232.581337:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 18 00000100:00100000:2.0:1789438232.581367:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+7:9696:x1876361749742336:12345-192.168.206.9@tcp:101:chown.0 00010000:00010000:2.0:1789438232.581394:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438232.581417:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb924e07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa157 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.581482:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb924e0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.581495:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb924e0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.581772:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb924e0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438232.581812:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789438232.581817:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789438232.581858:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb924e0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.581887:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb924e07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa157 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.581908:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb924e0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa157 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.581918:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872c00) 00010000:00010000:2.0:1789438232.581921:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789438232.581925:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f0400, rc 0) 00000100:00100000:2.0:1789438232.582177:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+8:9696:x1876361749742336:12345-192.168.206.9@tcp:101:chown.0 Request processed in 811us (7763us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438232.582197:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 18 00000100:00100000:3.0:1789438232.587121:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438232.587360:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749742464 00000100:00100000:1.0:1789438232.587372:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749742464 00000100:00100000:1.0:1789438232.587433:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 19 00000100:00100000:1.0:1789438232.587446:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+8:9696:x1876361749742464:12345-192.168.206.9@tcp:101:chown.0 00010000:00010000:1.0:1789438232.587466:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438232.587490:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb924e15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa15e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.587566:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb924e1c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.587581:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb924e1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.587595:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb924e1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.587611:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb924e23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.587618:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb924e23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.587625:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb924e23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.587897:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb924e2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.587906:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb924e2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.587929:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb924e2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438232.587957:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789438232.587960:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789438232.587978:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb924e2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.587989:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb924e1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.588176:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb924e1c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.588184:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb924e1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.588190:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9da600 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438232.588195:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb924e1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.588272:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb924e1c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.588298:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872c00) 00010000:00010000:1.0:1789438232.588301:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438232.588307:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb924e1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.588313:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb924e1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.588338:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb924e23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.588344:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb924e23 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.588351:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb924e23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.588356:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9db400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438232.588360:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb924e23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.588366:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb924e23 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.588374:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9991c7c83400) 00010000:00010000:1.0:1789438232.588376:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438232.588379:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb924e23 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.588385:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb924e23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.588423:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb924e15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa15e expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.588438:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb924e2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa15e expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.588456:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9991c7c83100) 00010000:00010000:1.0:1789438232.588458:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789438232.588461:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9dae00, rc 0) 00000100:00100000:1.0:1789438232.588591:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+9:9696:x1876361749742464:12345-192.168.206.9@tcp:101:chown.0 Request processed in 1146us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438232.588599:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 19 00000100:00100000:3.0:1789438232.599373:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438232.599680:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749742720 00000100:00100000:0.0:1789438232.599692:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749742720 00000100:00100000:0.0:1789438232.599804:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 20 00000100:00100000:0.0:1789438232.599817:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+9:9696:x1876361749742720:12345-192.168.206.9@tcp:36:chown.0 00010000:00010000:0.0:1789438232.599883:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438232.599911:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb924e2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa15e expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.599931:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9991c7c83100) 00010000:00010000:0.0:1789438232.599944:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789438232.599970:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb924e31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.599995:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb924e31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.600005:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb924e31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789438232.648924:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003882c071 reply state 000000006c63f172 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb924e31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438232.648943:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789438232.648959:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789438232.649085:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+10:9696:x1876361749742720:12345-192.168.206.9@tcp:36:chown.0 Request processed in 49267us (49841us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789438232.649095:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 20 00000001:00080000:2.0:1789438232.652125:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:0.0:1789438232.653055:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb924e31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.653070:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb924e31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.653077:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb924e31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.653082:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d62200 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438232.653087:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb924e31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.653094:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb924e31 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.653111:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9991c3ac2700) 00010000:00010000:0.0:1789438232.653114:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789438232.653119:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb924e31 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.653126:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb924e31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438232.664683:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438232.664820:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749742848 00000100:00100000:0.0:1789438232.664854:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749742848 00000100:00100000:0.0:1789438232.664920:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 21 00000100:00100000:0.0:1789438232.664932:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+6:9697:x1876361749742848:12345-192.168.206.9@tcp:101:touch.500 00010000:00010000:0.0:1789438232.664958:0:7624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438232.664977:0:7624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb924e38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa165 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789438232.667381:0:7624:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2355us 00010000:00010000:0.0:1789438232.687679:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb924e3f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.687703:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb924e3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.687734:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb924e3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.687754:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb924e46 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.687763:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb924e46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.687770:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb924e46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.688086:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb924e4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.688096:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb924e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.688104:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb924e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438232.688136:0:7624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789438232.688140:0:7624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789438232.688182:0:7624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb924e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.688195:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb924e3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.688202:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb924e3f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.688699:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb924e3f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.688978:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63c00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438232.688984:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb924e3f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.688994:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb924e3f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.689008:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872c00) 00010000:00010000:0.0:1789438232.689011:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438232.689016:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb924e3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.689023:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb924e3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.689044:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb924e46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.689063:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb924e46 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.689070:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb924e46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.689074:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438232.689077:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb924e46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.689083:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb924e46 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.689089:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9991c3ac2700) 00010000:00010000:0.0:1789438232.689092:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438232.689094:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb924e46 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.689100:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb924e46 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.689145:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb924e38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa165 expref: 8 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.689294:0:7624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb924e4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa165 expref: 7 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.689302:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9991c3ac2100) 00010000:00010000:0.0:1789438232.689305:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789438232.689314:0:7624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63200, rc 0) 00000100:00100000:0.0:1789438232.689521:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+7:9697:x1876361749742848:12345-192.168.206.9@tcp:101:touch.500 Request processed in 24591us (24845us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438232.689530:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 21 00000100:00100000:0.0:1789438232.698373:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438232.698588:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749743104 00000100:00100000:2.0:1789438232.698599:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749743104 00000100:00100000:2.0:1789438232.698667:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 22 00000100:00100000:2.0:1789438232.698678:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+7:9697:x1876361749743104:12345-192.168.206.9@tcp:101:touch.500 00010000:00010000:2.0:1789438232.698698:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438232.698805:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb924e54 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa16c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.699184:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924e5b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.699200:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924e5b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.699212:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924e5b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.699489:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924e62 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.699512:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924e62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.699526:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924e62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789438232.701310:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1789438232.701679:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb924e69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.701700:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb924e69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.701740:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb924e69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.701788:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924e5b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.701797:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924e5b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.701804:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924e5b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.701810:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438232.701816:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924e5b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.701824:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924e5b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.701838:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9991c3ac2100) 00010000:00010000:2.0:1789438232.701841:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438232.701846:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924e5b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.701864:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924e5b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789438232.701880:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002de6d9b8 reply state 0000000071d9c3bf transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924e62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438232.701893:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789438232.701941:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb924e54 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa16c expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.701961:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb924e69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa16c expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.701969:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9991d5872000) 00010000:00010000:2.0:1789438232.701971:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789438232.701974:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f0e00, rc 0) 00000100:00100000:2.0:1789438232.702074:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+10:9697:x1876361749743104:12345-192.168.206.9@tcp:101:touch.500 Request processed in 3397us (3709us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789438232.702085:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 22 00000100:00100000:0.0:1789438232.710523:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438232.710642:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749743360 00010000:00010000:2.0:1789438232.710649:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924e62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438232.710654:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749743360 00010000:00010000:2.0:1789438232.710672:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924e62 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.710694:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924e62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.710702:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0a00 already unused, calling callback (ffffffffc1f7c4f0) 00000100:00100000:1.0:1789438232.710753:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 23 00010000:00010000:2.0:1789438232.710766:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924e62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438232.710768:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa74aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+10:9697:x1876361749743360:12345-192.168.206.9@tcp:36:touch.500 00010000:00010000:2.0:1789438232.710791:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924e62 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.710813:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb55d98b2 (ffff9991d5872600) 00010000:00010000:2.0:1789438232.710817:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438232.710823:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924e62 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.710830:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924e62 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.710848:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438232.710880:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb924e69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa16c expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.710899:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9991d5872000) 00010000:00010000:1.0:1789438232.710909:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789438232.710951:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb924e77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.710979:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb924e77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.710990:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb924e77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789438232.711114:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de880392 reply state 00000000589d3fa3 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb924e77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438232.711123:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789438232.711215:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa74aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+10:9697:x1876361749743360:12345-192.168.206.9@tcp:36:touch.500 Request processed in 451us (698us total) trans 4294967301 rc 0/0 00010000:00010000:0.0:1789438232.713808:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb924e77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.713825:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb924e77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.713832:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb924e77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.713838:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dac00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438232.713843:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb924e77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.713851:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb924e77 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.713865:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9991c7c83e00) 00010000:00010000:0.0:1789438232.713868:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438232.713873:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb924e77 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.713880:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb924e77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438232.714328:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438232.714499:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 23 00000100:00100000:1.0:1789438232.714536:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749743488 00000100:00100000:1.0:1789438232.714950:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749743488 00000100:00100000:0.0:1789438232.718849:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 24 00000100:00100000:0.0:1789438232.718878:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+9:9697:x1876361749743488:12345-192.168.206.9@tcp:101:touch.500 00010000:00010000:0.0:1789438232.718904:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438232.718929:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb924e7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa173 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.718990:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb924e7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa173 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.719006:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb924e7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa173 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.719025:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9991c3ac2700) 00010000:00010000:0.0:1789438232.719029:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789438232.719033:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d62200, rc 0) 00000100:00100000:0.0:1789438232.719091:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+10:9697:x1876361749743488:12345-192.168.206.9@tcp:101:touch.500 Request processed in 220us (4767us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438232.719099:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 24 00000100:00100000:3.0:1789438232.726161:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438232.726325:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749743616 00000100:00100000:0.0:1789438232.726339:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749743616 00000100:00100000:0.0:1789438232.726396:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:0.0:1789438232.726417:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1876361749743616:12345-192.168.206.9@tcp:8:touch.500 00010000:00080000:0.0:1789438232.726454:0:6682:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 1274be99-2d57-4dac-a13e-a89426512ee0@192.168.206.9@tcp t0 exp 0000000000000000 cur 284 last 0 00000020:00000080:0.0:1789438232.726488:0:6682:0:(genops.c:1384:class_connect()) connect: client 1274be99-2d57-4dac-a13e-a89426512ee0, cookie 0x7a8dd0fcbb924e85 00002000:00100000:0.0:1789438232.726500:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1274be99-2d57-4dac-a13e-a89426512ee0/ffff9991fa637800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789438232.726523:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:0.0:1789438232.726806:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789438232.726853:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9991fa636800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789438232.726925:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+6:2352:x1876361749743616:12345-192.168.206.9@tcp:8:touch.500 Request processed in 508us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438232.726933:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:3.0:1789438232.729373:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438232.731642:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749743744 00000100:00100000:0.0:1789438232.731657:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749743744 00000100:00100000:0.0:1789438232.731811:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 17 00000100:00100000:0.0:1789438232.731822:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+6:0:x1876361749743744:12345-192.168.206.9@tcp:2:touch.500 00000100:00080000:2.0:1789438232.732171:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1789438232.802141:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:3.0:1789438232.802156:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1274be99-2d57-4dac-a13e-a89426512ee0 00000100:00100000:2.0:1789438232.802391:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+5:0:x1876361749743744:12345-192.168.206.9@tcp:2:touch.500 Request processed in 70563us (73019us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789438232.802403:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 17 00000100:00100000:1.0:1789438232.805476:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438232.805845:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749744000 00000100:00100000:3.0:1789438232.805856:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749744000 00000100:00100000:3.0:1789438232.805952:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 2 00000100:00100000:3.0:1789438232.805964:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+10:9697:x1876361749744000:12345-192.168.206.9@tcp:35:touch.500 00000100:00100000:3.0:1789438232.806405:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+11:9697:x1876361749744000:12345-192.168.206.9@tcp:35:touch.500 Request processed in 366us (860us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789438232.806415:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 2 00000100:00100000:1.0:1789438232.814807:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438232.814903:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749744128 00000100:00100000:0.0:1789438232.814914:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749744128 00000100:00100000:0.0:1789438232.814975:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 25 00000100:00100000:0.0:1789438232.814986:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+11:9698:x1876361749744128:12345-192.168.206.9@tcp:101:rm.0 00010000:00010000:0.0:1789438232.815014:0:7624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438232.815036:0:7624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb924e8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa17a expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.815110:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb924e93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.815126:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb924e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.815142:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb924e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438232.815181:0:7624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789438232.815186:0:7624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789438232.815242:0:7624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb924e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.815300:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb924e8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa17a expref: 13 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.815337:0:7624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb924e93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa17a expref: 12 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.815345:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9991c3ac2100) 00010000:00010000:0.0:1789438232.815348:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789438232.815352:0:7624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63c00, rc 0) 00000100:00100000:0.0:1789438232.815418:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+12:9698:x1876361749744128:12345-192.168.206.9@tcp:101:rm.0 Request processed in 434us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438232.815426:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 25 00000100:00100000:1.0:1789438232.818285:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438232.819083:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749744384 00000100:00100000:2.0:1789438232.819096:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749744384 00000100:00100000:2.0:1789438232.819194:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 26 00000100:00100000:2.0:1789438232.819218:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+12:9698:x1876361749744384:12345-192.168.206.9@tcp:101:rm.0 00010000:00010000:2.0:1789438232.819242:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438232.819264:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924e9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa181 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438232.819369:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789438232.819672:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924e9a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa181 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.819700:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872c00) 00010000:00010000:2.0:1789438232.819704:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789438232.819738:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924e9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa181 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.819753:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f0a00, rc 0) 00000100:00100000:2.0:1789438232.819816:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+13:9698:x1876361749744384:12345-192.168.206.9@tcp:101:rm.0 Request processed in 613us (1547us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1789438232.819823:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 26 00000100:00100000:1.0:1789438232.829831:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438232.830110:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749744512 00000100:00100000:0.0:1789438232.830121:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749744512 00000100:00100000:0.0:1789438232.830182:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 3 00000100:00100000:0.0:1789438232.830194:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+13:9698:x1876361749744512:12345-192.168.206.9@tcp:37:rm.0 00000100:00100000:0.0:1789438232.836774:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+13:9698:x1876361749744512:12345-192.168.206.9@tcp:37:rm.0 Request processed in 6571us (6943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438232.836789:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 3 00000100:00100000:1.0:1789438232.851081:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438232.851172:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749744768 00000100:00100000:3.0:1789438232.851206:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749744768 00000100:00100000:3.0:1789438232.851297:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:3.0:1789438232.851313:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d21bcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+13:9698:x1876361749744768:12345-192.168.206.9@tcp:35:rm.0 00000100:00100000:3.0:1789438232.851664:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d21bcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+14:9698:x1876361749744768:12345-192.168.206.9@tcp:35:rm.0 Request processed in 354us (592us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789438232.851673:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:1.0:1789438232.859063:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438232.859189:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749745024 00000100:00100000:0.0:1789438232.859209:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749745024 00000100:00100000:0.0:1789438232.859299:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 27 00000100:00100000:0.0:1789438232.859311:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+14:9698:x1876361749745024:12345-192.168.206.9@tcp:101:rm.0 00010000:00010000:0.0:1789438232.859344:0:7624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438232.859369:0:7624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb924ea8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa188 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.859509:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb924eaf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.859526:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb924eaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.859539:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb924eaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438232.859552:0:7624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789438232.859698:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb924ea8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa188 expref: 17 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.859781:0:7624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb924eaf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa188 expref: 16 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.859790:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9991c3ac2100) 00010000:00010000:0.0:1789438232.859794:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789438232.859798:0:7624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63000, rc 0) 00000100:00100000:0.0:1789438232.859868:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+16:9698:x1876361749745024:12345-192.168.206.9@tcp:101:rm.0 Request processed in 559us (819us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789438232.859875:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 27 00000100:00100000:1.0:1789438232.865594:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438232.866968:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749745152 00000100:00100000:0.0:1789438232.866983:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749745152 00000100:00100000:0.0:1789438232.867248:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 28 00000100:00100000:0.0:1789438232.867262:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+16:9698:x1876361749745152:12345-192.168.206.9@tcp:41:rm.0 00000004:00000024:0.0:1789438232.867893:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1789438232.868007:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+16:9698:x1876361749745152:12345-192.168.206.9@tcp:41:rm.0 Request processed in 747us (2425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438232.868016:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 28 00000100:00100000:1.0:1789438232.875089:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438232.875677:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749745280 00000100:00100000:0.0:1789438232.875689:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749745280 00000100:00100000:0.0:1789438232.875797:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 29 00000100:00100000:0.0:1789438232.875809:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+16:9698:x1876361749745280:12345-192.168.206.9@tcp:101:rm.0 00010000:00010000:0.0:1789438232.875832:0:7624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438232.875854:0:7624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb924ebd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa18f expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.875920:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb924ec4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.875937:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb924ec4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.875948:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb924ec4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.875964:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb924ecb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.875970:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb924ecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.875977:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb924ecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.878320:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb924ed2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.878356:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb924ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.878369:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb924ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438232.878406:0:7624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789438232.878411:0:7624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789438232.878432:0:7624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb924ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.878443:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb924ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.878453:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb924ec4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.878459:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb924ec4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.878466:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb924ec4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.878472:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63e00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438232.878476:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb924ec4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.878483:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb924ec4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.878496:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9991c3ac2100) 00010000:00010000:0.0:1789438232.878499:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438232.878510:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb924ec4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.878517:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb924ec4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.878637:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb924ecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.878645:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb924ecb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.878651:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb924ecb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.878655:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63600 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438232.878658:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb924ecb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.878664:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb924ecb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.878671:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb55d98b2 (ffff9991c3ac2e00) 00010000:00010000:0.0:1789438232.878673:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438232.878676:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb924ecb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.878682:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb924ecb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.878750:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb924ebd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa18f expref: 18 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.878780:0:7624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb924ed2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa18f expref: 17 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438232.878789:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9991c3ac2700) 00010000:00010000:0.0:1789438232.878791:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789438232.878793:0:7624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63a00, rc 0) 00000100:00100000:0.0:1789438232.878933:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+17:9698:x1876361749745280:12345-192.168.206.9@tcp:101:rm.0 Request processed in 3125us (3852us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438232.878942:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 29 00000100:00100000:2.0:1789438232.888486:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769700864:0@lo:400:kworker.0 00000100:00100000:2.0:1789438232.888577:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438232.888817:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789438232.888824:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876361769700736:0@lo:400:kworker.0 00000100:00100000:2.0:1789438232.888845:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769700992:0@lo:400:kworker.0 00000100:00100000:0.0:1789438232.888884:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438232.888953:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769700608:0@lo:400:kworker.0 00000100:00100000:0.0:1789438232.890967:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769701248:0@lo:400:kworker.0 00000100:00100000:0.0:1789438232.891405:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438232.891478:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769701248 00000100:00100000:0.0:1789438232.891487:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769701248 00000100:00100000:0.0:1789438232.891612:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789438232.891623:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769701248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438232.891677:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769701248:12345-0@lo:400:kworker.0 Request processed in 56us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438232.891684:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1789438232.891754:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991d06b1500 x1876361769701248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438232.891768:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769701248:0@lo:400:kworker.0 00000100:00100000:3.0:1789438232.891860:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438232.891891:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769701120:0@lo:400:kworker.0 00000100:00100000:3.0:1789438232.891918:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438232.891945:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769700864 00000100:00100000:3.0:1789438232.891949:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769700864 00000100:00100000:2.0:1789438232.892059:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438232.892069:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438232.892144:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769700608 00000100:00100000:0.0:1789438232.892163:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769700608 00000100:00100000:3.0:1789438232.892237:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769700736 00000100:00100000:3.0:1789438232.892241:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769700736 00000100:00100000:3.0:1789438232.892252:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769701120 00000100:00100000:3.0:1789438232.892254:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769701120 00000100:00100000:3.0:1789438232.892267:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749745536 00000100:00100000:3.0:1789438232.892269:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749745536 00000100:00100000:3.0:1789438232.892294:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789438232.892301:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769700864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438232.892349:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769700864:12345-0@lo:400:kworker.0 Request processed in 48us (3773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438232.892355:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789438232.892370:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789438232.892378:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876361769700736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438232.892420:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876361769700736:12345-0@lo:400:kworker.0 Request processed in 44us (3539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438232.892436:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789438232.892449:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789438232.892455:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769701120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438232.892494:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769701120:12345-0@lo:400:kworker.0 Request processed in 40us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438232.892503:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789438232.892524:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 30 00000100:00100000:3.0:1789438232.892533:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+17:9698:x1876361749745536:12345-192.168.206.9@tcp:36:rm.0 00000100:00100000:1.0:1789438232.892548:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876361769700736:0@lo:400:kworker.0 00010000:00010000:3.0:1789438232.892593:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789438232.892623:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb924ed2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa18f expref: 17 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.892660:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb924e7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa173 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.892672:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9991c3ac2700) 00010000:00010000:3.0:1789438232.892688:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb924e93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa17a expref: 15 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.892696:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9991c3ac2100) 00010000:00010000:3.0:1789438232.892699:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789438232.892765:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924ed9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.892780:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924ed9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.892806:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924ed9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.892825:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb924ee0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.892834:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb924ee0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.892841:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb924ee0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.892978:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55c00/0x7a8dd0fcbb924ee7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.892987:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55c00/0x7a8dd0fcbb924ee7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.893168:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55c00/0x7a8dd0fcbb924ee7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438232.894869:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769700864:0@lo:400:kworker.0 00000100:00080000:2.0:1789438232.894985:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789438232.894993:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789438232.895013:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769700992 00000100:00100000:2.0:1789438232.895022:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769700992 00000100:00080000:1.0:1789438232.895397:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789438232.895462:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789438232.895475:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769700992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438232.895767:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769700992:12345-0@lo:400:kworker.0 Request processed in 294us (3715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438232.895776:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1789438232.895878:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991d06b3100 x1876361769700992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000040:00080000:3.0:1789438232.896429:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1789438232.896444:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 285161735831ns, next at 286161732530ns, rc = 0 00010000:00010000:3.0:1789438232.896527:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb924eee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.897106:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb924eee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.897122:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb924eee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.897149:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb924eee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.897156:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb924eee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.897163:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb924eee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.897179:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789438232.897202:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55c00/0x7a8dd0fcbb924ee7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.897207:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55c00/0x7a8dd0fcbb924ee7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.897213:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55c00/0x7a8dd0fcbb924ee7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.897219:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55c00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438232.897224:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55c00/0x7a8dd0fcbb924ee7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.897233:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55c00/0x7a8dd0fcbb924ee7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.897267:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9991d192ca00) 00010000:00010000:3.0:1789438232.897271:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789438232.897288:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55c00/0x7a8dd0fcbb924ee7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.897305:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55c00/0x7a8dd0fcbb924ee7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.897327:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924ed9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.897334:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924ed9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.897340:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924ed9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.897345:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54c00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438232.897349:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924ed9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.897355:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924ed9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.897364:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9991c3ac2100) 00010000:00010000:3.0:1789438232.897366:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789438232.897370:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924ed9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.897375:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924ed9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789438232.897385:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e3a914d0 reply state 00000000affafa89 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb924ee0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438232.897393:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789438232.897484:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+16:9698:x1876361749745536:12345-192.168.206.9@tcp:36:rm.0 Request processed in 4949us (5418us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789438232.897493:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 30 00010000:00010000:2.0:1789438232.897615:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789438232.897644:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb924eee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.897655:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55000 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:2.0:1789438232.897660:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb924eee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.897670:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb924eee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.897688:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9991d192ca00) 00010000:00010000:2.0:1789438232.897690:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789438232.897695:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb924eee lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.897701:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb924eee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.897755:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438232.897758:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438232.897759:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438232.897965:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769701120:0@lo:400:kworker.0 00000100:00100000:0.0:1789438232.898357:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789438232.898375:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3311:x1876361769700608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438232.900132:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769700992:0@lo:400:kworker.0 00000100:00100000:0.0:1789438232.901750:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3311:x1876361769700608:12345-0@lo:400:kworker.0 Request processed in 3371us (9877us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438232.901766:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789438232.907971:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769700608:0@lo:400:kworker.0 00010000:00010000:2.0:1789438232.908409:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb924ee0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.908429:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb924ee0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438232.908432:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00010000:00010000:2.0:1789438232.908446:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb924ee0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.908454:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55200 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438232.908460:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb924ee0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.908493:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb924ee0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.908527:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb55d98b2 (ffff9991d192c100) 00010000:00010000:2.0:1789438232.908530:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438232.908537:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb924ee0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.908544:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb924ee0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb55d98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438232.911696:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749745792 00000100:00100000:0.0:1789438232.912101:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749745792 00000100:00100000:1.0:1789438232.916920:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 5 00000100:00100000:1.0:1789438232.916935:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+15:9698:x1876361749745792:12345-192.168.206.9@tcp:35:rm.0 00000100:00100000:1.0:1789438232.917338:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+16:9698:x1876361749745792:12345-192.168.206.9@tcp:35:rm.0 Request processed in 403us (8908us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789438232.917348:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 5 00000100:00100000:3.0:1789438232.922955:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438232.923456:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749746048 00000100:00100000:1.0:1789438232.923467:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749746048 00000100:00100000:1.0:1789438232.923533:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 31 00000100:00100000:1.0:1789438232.923629:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+16:9698:x1876361749746048:12345-192.168.206.9@tcp:36:rm.0 00010000:00010000:1.0:1789438232.923689:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789438232.923839:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb924eaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa188 expref: 16 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.923880:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb924e4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa165 expref: 15 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.923891:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9991c3ac2100) 00010000:00010000:1.0:1789438232.923906:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb924e0e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa157 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438232.923914:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872c00) 00010000:00010000:1.0:1789438232.923920:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789438232.924033:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924ef5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.924058:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924ef5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.924072:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924ef5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.924102:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb924efc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.924110:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb924efc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.924117:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb924efc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.924445:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924f03 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.924466:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924f03 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.924473:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924f03 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438232.925186:0:7624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789438232.925207:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924f03 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.925224:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924f03 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.925232:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924f03 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.925239:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438232.925245:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924f03 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.925253:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924f03 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.925270:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9991d5872000) 00010000:00010000:2.0:1789438232.925273:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789438232.925290:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924f03 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.925297:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924f03 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.925325:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924ef5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.925339:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924ef5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.925346:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924ef5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.925352:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0a00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438232.925355:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924ef5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.925361:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924ef5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.925369:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872600) 00010000:00010000:2.0:1789438232.925371:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438232.925374:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924ef5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438232.925380:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924ef5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789438232.925393:0:7624:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062cb526e reply state 00000000ee4d3ee4 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb924efc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438232.925403:0:7624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789438232.925519:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+15:9698:x1876361749746048:12345-192.168.206.9@tcp:36:rm.0 Request processed in 1972us (2567us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789438232.925530:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 31 00010000:00010000:3.0:1789438232.934791:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb924efc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.934809:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb924efc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.934817:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb924efc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.934823:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f1800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438232.934828:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb924efc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.934835:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb924efc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.934854:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9991d5872900) 00010000:00010000:3.0:1789438232.934857:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789438232.934862:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb924efc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438232.934869:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb924efc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438233.405485:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789438233.405518:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fabcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769701376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789438233.405592:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438233.405746:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769701376 00000100:00100000:2.0:1789438233.405755:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769701376 00000100:00100000:2.0:1789438233.405825:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789438233.405835:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769701376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789438233.405863:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789438233.405921:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769701376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438233.405928:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1789438233.406119:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991fabcbb80 x1876361769701376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789438233.406140:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fabcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769701376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789438233.408600:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769701504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789438233.408669:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438233.408767:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769701504 00000100:00100000:2.0:1789438233.408777:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769701504 00000100:00100000:2.0:1789438233.408835:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789438233.408844:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769701504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789438233.408875:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789438233.411418:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769701504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2566us (2739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438233.411432:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1789438233.411527:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991fa749180 x1876361769701504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789438233.411553:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769701504:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789438233.462944:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438234.491205:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438235.095127:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438235.095172:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438235.095205:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438235.095230:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438235.095255:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749746432 00000100:00100000:3.0:1789438235.095276:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749746432 00000100:00100000:3.0:1789438235.095332:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 55 00000100:00100000:3.0:1789438235.095343:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1274be99-2d57-4dac-a13e-a89426512ee0+5:2356:x1876361749746432:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438235.095408:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1274be99-2d57-4dac-a13e-a89426512ee0+5:2356:x1876361749746432:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 67us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438235.095416:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 55 00000100:00100000:3.0:1789438235.095440:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749746304 00000100:00100000:3.0:1789438235.095444:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749746304 00000100:00100000:3.0:1789438235.095468:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749746560 00000100:00100000:3.0:1789438235.095471:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749746560 00000100:00100000:3.0:1789438235.095487:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 97 00000100:00100000:3.0:1789438235.095493:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+14:2355:x1876361749746304:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438235.095524:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+14:2355:x1876361749746304:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 31us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438235.095530:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 97 00000100:00100000:3.0:1789438235.095542:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 98 00000100:00100000:3.0:1789438235.095548:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2355:x1876361749746560:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438235.095571:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2355:x1876361749746560:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 23us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438235.095577:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 98 00000100:00100000:1.0:1789438235.096002:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749746176 00000100:00100000:1.0:1789438235.096008:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749746176 00000100:00100000:1.0:1789438235.096055:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 246 00000100:00100000:1.0:1789438235.096065:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+13:2356:x1876361749746176:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438235.096097:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+13:2356:x1876361749746176:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 34us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438235.096607:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 246 00000100:00080000:1.0:1789438235.096647:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789438235.096653:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789438235.514237:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438236.535097:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789438236.888576:0:11598:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1789438237.559188:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789438237.799136:0:11646:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe9b0435e0 20000000:00000080:0.0:1789438237.799154:0:11646:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9991ffa89400 uarg=0000000000000000 20000000:01000000:0.0:1789438237.799189:0:11646:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789438237.799196:0:11646:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789438237.799201:0:11646:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1789438237.800022:0:11647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1789438237.800246:0:11646:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1789438237.809891:0:11646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1789438237.809946:0:11646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1789438237.810005:0:11646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1789438237.810026:0:11646:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789438237.810046:0:11646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9991e74f1e00/0x7a8dd0fcbb924f0a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438237.810066:0:11646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff999202045600/0x7a8dd0fcbb924dac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa142 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438237.810075:0:11646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991ff9dbe00/0x7a8dd0fcbb924db3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa149 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438237.810090:0:11646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991ff9da200/0x7a8dd0fcbb924dc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924dba expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438237.810098:0:11646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff999202044800/0x7a8dd0fcbb924dcf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924dc8 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438237.810105:0:11646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff999202045000/0x7a8dd0fcbb924ddd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924dd6 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438237.810112:0:11646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9991e74f1e00/0x7a8dd0fcbb924f0a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438237.810151:0:11646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff999202045000/0x7a8dd0fcbb924ddd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb924dd6 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438237.810168:0:11646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff999202045000/0x7a8dd0fcbb924ddd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924dd6 expref: 18 pid: 5831 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438237.810182:0:11646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11646:1876361769701632:0@lo:104: 00000100:00100000:2.0:1789438237.810241:0:11646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789438237.810362:0:11646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff999202044800/0x7a8dd0fcbb924dcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb924dc8 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438237.810372:0:11646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff999202044800/0x7a8dd0fcbb924dcf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924dc8 expref: 18 pid: 5831 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438237.810381:0:11646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11646:1876361769701760:0@lo:104: 00000100:00100000:2.0:1789438237.810401:0:11646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789438237.810538:0:11646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991ff9da200/0x7a8dd0fcbb924dc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb924dba expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438237.810614:0:11646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9991ff9da200/0x7a8dd0fcbb924dc1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924dba expref: 18 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438237.810625:0:11646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11646:1876361769701888:0@lo:104: 00000100:00100000:2.0:1789438237.810650:0:11646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438237.810727:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769701632 00000100:00100000:1.0:1789438237.810736:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769701632 00000100:00100000:1.0:1789438237.810784:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769701760 00000100:00100000:1.0:1789438237.810793:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769701760 00000100:00100000:1.0:1789438237.810809:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789438237.810818:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+4:11646:x1876361769701632:12345-0@lo:104: 00010000:00010000:1.0:1789438237.810829:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924dd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924ddd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438237.810877:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1789438237.810878:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789438237.810883:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+4:11646:x1876361769701632:12345-0@lo:104: Request processed in 67us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438237.810888:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+4:11646:x1876361769701760:12345-0@lo:104: 00000100:00100000:1.0:1789438237.810889:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1789438237.810896:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9991ff9dba00/0x7a8dd0fcbb924dc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924dcf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438237.810911:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789438237.810916:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924dd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924ddd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438237.810923:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9db200 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:1.0:1789438237.810926:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924dd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb924ddd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438237.810929:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789438237.810933:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+3:11646:x1876361769701760:12345-0@lo:104: Request processed in 50us (532us total) trans 0 rc 0/0 00010000:00010000:1.0:1789438237.810935:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924dd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb924ddd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438237.810939:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 10000000:00010000:1.0:1789438237.810942:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924dd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb924ddd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789438237.810948:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789438237.810967:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789438237.810979:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924dd6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924ddd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438237.810985:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789438237.811005:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924dd6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924ddd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438237.811017:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb924dd6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924ddd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438237.811028:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438237.811030:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438237.811031:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438237.811038:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789438237.811050:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769702016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789438237.811076:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789438237.811087:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438237.811093:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991ff9dba00/0x7a8dd0fcbb924dc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924dcf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438237.811099:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dba00 already unused, calling callback (ffffffffc1b57c20) 00000100:00100000:1.0:1789438237.811102:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769702016 00000100:00100000:1.0:1789438237.811105:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769702016 10000000:00010000:0.0:1789438237.811108:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991ff9dba00/0x7a8dd0fcbb924dc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb924dcf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438237.811122:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff999202045000/0x7a8dd0fcbb924ddd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924dd6 expref: 19 pid: 5831 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438237.811127:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991ff9dba00/0x7a8dd0fcbb924dc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb924dcf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789438237.811133:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991ff9dba00/0x7a8dd0fcbb924dc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb924dcf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789438237.811138:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1789438237.811141:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789438237.811147:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3312:x1876361769702016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789438237.811151:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991ff9dba00/0x7a8dd0fcbb924dc8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924dcf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438237.811155:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438237.811157:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789438237.811159:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff999202045000/0x7a8dd0fcbb924ddd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924dd6 expref: 19 pid: 5831 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438237.811166:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991ff9dba00/0x7a8dd0fcbb924dc8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924dcf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438237.811169:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff999202045000/0x7a8dd0fcbb924ddd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924dd6 expref: 19 pid: 5831 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438237.811172:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991ff9dba00/0x7a8dd0fcbb924dc8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924dcf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438237.811180:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438237.811182:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438237.811183:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789438237.811183:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438237.811188:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438237.811190:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438237.811203:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3312:x1876361769702016:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438237.811209:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1789438237.811368:0:11646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991ff9dbe00/0x7a8dd0fcbb924db3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa149 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438237.811380:0:11646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9991ff9dbe00/0x7a8dd0fcbb924db3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa149 expref: 12 pid: 5831 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438237.811390:0:11646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11646:1876361769702272:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789438237.811542:0:11646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff999202045600/0x7a8dd0fcbb924dac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa142 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438237.811674:0:11646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff999202045600/0x7a8dd0fcbb924dac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa142 expref: 12 pid: 5833 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438237.811686:0:11646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11646:1876361769702400:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789438237.811738:0:11646:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d04d4180 going to sleep for 11 seconds 00010000:00010000:2.0:1789438237.811758:0:11646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff999202045000/0x7a8dd0fcbb924ddd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb924dd6 expref: 18 pid: 5831 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438237.811769:0:11646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11646:1876361769701632:0@lo:104: 00000100:00100000:2.0:1789438237.811777:0:11646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11646:1876361769701760:0@lo:104: 00000100:00100000:3.0:1789438237.811878:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769701888 00000100:00100000:3.0:1789438237.811883:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769701888 00000100:00100000:1.0:1789438237.812047:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789438237.812060:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769702144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789438237.812067:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789438237.812075:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+3:11646:x1876361769701888:12345-0@lo:104: 00010000:00010000:1.0:1789438237.812083:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924dba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924dc1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438237.812087:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789438237.812120:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789438237.812127:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+3:11646:x1876361769701888:12345-0@lo:104: Request processed in 53us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438237.812132:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789438237.812156:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769702016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789438237.812178:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769702144 00000100:00100000:1.0:1789438237.812181:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769702144 00010000:00010000:0.0:1789438237.812187:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789438237.812191:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924dba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb924dc1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438237.812195:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff999202044800/0x7a8dd0fcbb924dcf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924dc8 expref: 18 pid: 5831 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438237.812203:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999202045800 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:0.0:1789438237.812206:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924dba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb924dc1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438237.812214:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789438237.812220:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa74a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+18:3312:x1876361769702144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789438237.812225:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924dba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb924dc1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438237.812228:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438237.812233:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff999202044800/0x7a8dd0fcbb924dcf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924dc8 expref: 18 pid: 5831 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789438237.812233:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924dba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb924dc1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789438237.812239:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789438237.812243:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff999202044800/0x7a8dd0fcbb924dcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924dc8 expref: 18 pid: 5831 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438237.812264:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff999202044800/0x7a8dd0fcbb924dcf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb924dc8 expref: 18 pid: 5831 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438237.812269:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924dba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924dc1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438237.812274:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789438237.812276:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789438237.812291:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924dba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924dc1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438237.812298:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff999202045800/0x7a8dd0fcbb924dba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb924dc1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438237.812300:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa74a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7073a0da-08cf-42fe-8791-a8c6139408f2+17:3312:x1876361769702144:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (213us total) trans 0 rc 0/0 00010000:00010000:0.0:1789438237.812312:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438237.812314:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1789438237.812314:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438237.812316:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438237.812329:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789438237.812337:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa74b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769702528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789438237.812349:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769702144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789438237.812365:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438237.812402:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769702528 00000100:00100000:0.0:1789438237.812406:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769702528 00010000:00010000:0.0:1789438237.812428:0:8438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991ff9da200/0x7a8dd0fcbb924dc1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924dba expref: 17 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438237.812450:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789438237.812456:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d0510850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7073a0da-08cf-42fe-8791-a8c6139408f2+17:3310:x1876361769702528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789438237.812463:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438237.812467:0:8438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991ff9da200/0x7a8dd0fcbb924dc1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924dba expref: 17 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438237.812478:0:8438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991ff9da200/0x7a8dd0fcbb924dc1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb924dba expref: 17 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438237.812487:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789438237.812520:0:11646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991ff9da200/0x7a8dd0fcbb924dc1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb924dba expref: 17 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438237.812520:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d0510850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7073a0da-08cf-42fe-8791-a8c6139408f2+17:3310:x1876361769702528:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438237.812526:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789438237.812539:0:11646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11646:1876361769701888:0@lo:104: 00000100:00100000:1.0:1789438237.812645:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa74b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769702528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789438237.821157:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438237.821279:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438237.821315:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749746688 00000100:00100000:1.0:1789438237.821325:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749746688 00000100:00100000:0.0:1789438237.821404:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749746816 00000100:00100000:0.0:1789438237.821408:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749746816 00010000:00010000:0.0:1789438237.821443:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff999202045600/0x7a8dd0fcbb924dac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa142 expref: 14 pid: 5833 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438237.821470:0:11646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11646:1876361769702272:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789438237.821475:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 33 00000100:00100000:3.0:1789438237.821479:0:11646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11646:1876361769702400:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789438237.821483:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58dec870-790c-4419-a02f-595f69c3b298+14:2354:x1876361749746816:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789438237.821496:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438237.821502:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff999202045600/0x7a8dd0fcbb924dac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa142 expref: 14 pid: 5833 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438237.821512:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff999202045600/0x7a8dd0fcbb924dac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa142 expref: 14 pid: 5833 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438237.821538:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991ff9dbe00/0x7a8dd0fcbb924db3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa149 expref: 14 pid: 5831 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438237.821572:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 34 00000100:00100000:1.0:1789438237.821579:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58dec870-790c-4419-a02f-595f69c3b298+14:2354:x1876361749746688:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789438237.821587:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438237.821591:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991ff9dbe00/0x7a8dd0fcbb924db3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa149 expref: 14 pid: 5831 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438237.822413:0:11646:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9991e74f1e00/0x7a8dd0fcbb924f0a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438237.825929:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff999202045600/0x7a8dd0fcbb924dac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa142 expref: 14 pid: 5833 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438237.825965:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438237.826041:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58dec870-790c-4419-a02f-595f69c3b298+13:2354:x1876361749746816:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 4557us (4761us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438237.826052:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 33 00010000:00010000:1.0:1789438237.826431:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991ff9dbe00/0x7a8dd0fcbb924db3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa149 expref: 12 pid: 5831 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438237.826448:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991ff9dbe00/0x7a8dd0fcbb924db3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa149 expref: 12 pid: 5831 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438237.826460:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9991e74f1e00/0x7a8dd0fcbb924f0a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438237.826469:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991e74f1e00/0x7a8dd0fcbb924f0a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438237.826510:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9991e74f1e00/0x7a8dd0fcbb924f0a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438237.826519:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9991e74f1e00/0x7a8dd0fcbb924f0a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438237.826527:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9991e74f1e00/0x7a8dd0fcbb924f0a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438237.826535:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9991e74f1e00/0x7a8dd0fcbb924f0a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438237.826542:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f1e00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:1.0:1789438237.826546:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9991e74f1e00/0x7a8dd0fcbb924f0a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438237.826567:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9991e74f1e00/0x7a8dd0fcbb924f0a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438237.826590:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9991e74f1e00/0x7a8dd0fcbb924f0a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438237.826601:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438237.826631:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58dec870-790c-4419-a02f-595f69c3b298+11:2354:x1876361749746688:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 5052us (5483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438237.826639:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 34 00010000:00010000:3.0:1789438237.829699:0:11646:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9991e74f1e00/0x7a8dd0fcbb924f0a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438237.829764:0:11646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9991e74f1e00/0x7a8dd0fcbb924f0a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438237.829772:0:11646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991e74f1e00/0x7a8dd0fcbb924f0a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438238.012042:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789438238.012065:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fabcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769702656:0@lo:400:kworker.0 00000100:00100000:3.0:1789438238.012131:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438238.012190:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769702656 00000100:00100000:3.0:1789438238.012198:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769702656 00000100:00100000:3.0:1789438238.012341:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789438238.012351:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769702656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438238.012405:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769702656:12345-0@lo:400:kworker.0 Request processed in 56us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438238.012413:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789438238.012464:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fabcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769702656:0@lo:400:kworker.0 00000100:00100000:3.0:1789438238.012505:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789438238.012523:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fabcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876361769702784:0@lo:400:kworker.0 00000100:00100000:3.0:1789438238.012548:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438238.012579:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769702784 00000100:00100000:3.0:1789438238.012584:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769702784 00000100:00100000:3.0:1789438238.012616:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789438238.012622:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876361769702784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438238.012656:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876361769702784:12345-0@lo:400:kworker.0 Request processed in 34us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438238.012662:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:3.0:1789438238.012677:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789438238.012698:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fabcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876361769702784:0@lo:400:kworker.0 00000100:00100000:3.0:1789438238.012749:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fabcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769702912:0@lo:400:kworker.0 00000100:00100000:3.0:1789438238.012776:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438238.012807:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769702912 00000100:00100000:3.0:1789438238.012811:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769702912 00000100:00100000:3.0:1789438238.012842:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789438238.012849:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769702912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438238.012880:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769702912:12345-0@lo:400:kworker.0 Request processed in 33us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438238.012886:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1789438238.012903:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789438238.012920:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991fabcb100 x1876361769702912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438238.012931:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fabcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769702912:0@lo:400:kworker.0 00000100:00100000:3.0:1789438238.012961:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fabcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876361769703040:0@lo:400:kworker.0 00000100:00100000:3.0:1789438238.012994:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438238.013019:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769703040 00000100:00100000:3.0:1789438238.013023:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769703040 00000100:00100000:3.0:1789438238.013050:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789438238.013055:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876361769703040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438238.013084:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876361769703040:12345-0@lo:400:kworker.0 Request processed in 29us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438238.013089:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1789438238.013104:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789438238.013118:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fabcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876361769703040:0@lo:400:kworker.0 00000100:00100000:3.0:1789438238.013143:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789438238.013149:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fabcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769703168:0@lo:400:kworker.0 00000100:00100000:3.0:1789438238.013172:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438238.013199:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769703168 00000100:00100000:3.0:1789438238.013203:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769703168 00000100:00100000:3.0:1789438238.017869:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789438238.017887:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769703168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438238.017983:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769703168:12345-0@lo:400:kworker.0 Request processed in 102us (4808us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438238.017991:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1789438238.018023:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789438238.018063:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991fabcb100 x1876361769703168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438238.018076:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fabcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769703168:0@lo:400:kworker.0 00000001:00080000:2.0:1789438238.113815:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967305 is committed 00000001:00080000:2.0:1789438238.113833:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:2.0:1789438238.113846:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1789438238.113860:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1789438238.114047:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789438238.114072:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa74a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769703296:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789438238.114156:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438238.115748:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769703296 00000100:00100000:0.0:1789438238.115762:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769703296 00000100:00100000:0.0:1789438238.115832:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789438238.115844:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769703296:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789438238.115874:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1789438238.115913:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa8a918, atime: 0x6aa8a918, ctime: 0x6aa8a918, blocks: 0x1 00010000:00010000:0.0:1789438238.115921:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6d564b8/0x7a8dd0fcbb924f11 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438238.115938:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=290s v=(0 0) 00010000:00010000:0.0:1789438238.115943:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789438238.115949:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6d564b8/0x7a8dd0fcbb924f11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438238.115966:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6d564b8/0x7a8dd0fcbb924f11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438238.115976:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6d564b8/0x7a8dd0fcbb924f11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438238.115999:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6d564b8/0x7a8dd0fcbb924f11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438238.116016:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789438238.116612:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1876361769703296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 769us (2455us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789438238.116622:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1789438238.116739:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:3.0:1789438238.116745:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9991fa74a680/2, rc 0, transno 4294967300 00010000:00010000:1.0:1789438238.116747:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6d564b8/0x7a8dd0fcbb924f11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438238.116756:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa74a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769703296:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789438238.116760:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d62a00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:1.0:1789438238.116766:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6d564b8/0x7a8dd0fcbb924f11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438238.116778:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6d564b8/0x7a8dd0fcbb924f11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438238.116800:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6d564b8/0x7a8dd0fcbb924f11 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438238.116808:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6d564b8/0x7a8dd0fcbb924f11 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438238.116831:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438238.116833:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438238.116835:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438238.519070:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fabcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769703424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789438238.519145:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438238.519297:0:10069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769703424 00000100:00100000:1.0:1789438238.519306:0:10069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769703424 00000100:00100000:1.0:1789438238.519353:0:10069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789438238.519363:0:10069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876361769703424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789438238.519398:0:10069:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789438238.519443:0:10069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876361769703424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438238.519450:0:10069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789438238.519857:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fabcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769703424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789438238.520108:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769703552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789438238.520147:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438238.520213:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769703552 00000100:00100000:0.0:1789438238.520219:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769703552 00000100:00100000:0.0:1789438238.520246:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789438238.520267:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769703552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789438238.520287:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438238.526451:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769703552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6175us (6293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438238.526467:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1789438238.526654:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991fa749f80 x1876361769703552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438238.526678:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769703552:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789438238.583796:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789438239.159385:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789438239.159393:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9991ffa93000 from 7 10000000:01000000:2.0:1789438239.159399:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789438239.159450:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991e74f1e00/0x7a8dd0fcbb924f18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438239.159462:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991e74f1e00/0x7a8dd0fcbb924f18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438239.159473:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991e74f1e00/0x7a8dd0fcbb924f18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438239.159500:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769703680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789438239.159569:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438239.159641:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d04d43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789438239.159896:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769703680 00000100:00100000:0.0:1789438239.159905:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769703680 00000100:00100000:0.0:1789438239.159968:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789438239.159979:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+16:5836:x1876361769703680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789438239.159992:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438239.160007:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991f3d62800/0x7a8dd0fcbb924f1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924f18 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438239.160032:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991f3d62800/0x7a8dd0fcbb924f1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924f18 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438239.160062:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991f3d62800/0x7a8dd0fcbb924f1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924f18 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438239.160070:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d62800, rc 0) 00000100:00100000:0.0:1789438239.160123:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+17:5836:x1876361769703680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438239.160130:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1789438239.160283:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769703680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789438239.160307:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991e74f1e00/0x7a8dd0fcbb924f18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924f1f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438239.160316:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991e74f1e00/0x7a8dd0fcbb924f18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924f1f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438239.160376:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769703808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789438239.160418:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438239.160494:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d04d43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438239.161235:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769703808 00000100:00100000:3.0:1789438239.161276:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769703808 00000100:00100000:3.0:1789438239.161334:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789438239.161346:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+17:5836:x1876361769703808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789438239.161935:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+17:5836:x1876361769703808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 591us (1515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438239.161943:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789438239.162049:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769703808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789438239.162097:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769703936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789438239.162146:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438239.162185:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d04d43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789438239.162257:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769703936 00000100:00100000:1.0:1789438239.162262:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769703936 00000100:00100000:1.0:1789438239.162297:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789438239.162305:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+17:5836:x1876361769703936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789438239.162478:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+17:5836:x1876361769703936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438239.162485:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1789438239.162634:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769703936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789438239.163285:0:11663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:11663:1876361769704064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789438239.163331:0:11663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438239.163364:0:11663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d04d4480 going to sleep for 11 seconds 00000100:00100000:1.0:1789438239.163424:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769704064 00000100:00100000:1.0:1789438239.163429:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769704064 00000100:00100000:1.0:1789438239.163453:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789438239.163460:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+17:11663:x1876361769704064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789438239.163867:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+17:11663:x1876361769704064:12345-0@lo:502:llog_process_th.0 Request processed in 405us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438239.163876:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789438239.164020:0:11663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:11663:1876361769704064:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789438239.164046:0:11663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789438239.164055:0:11663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789438239.164058:0:11663:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789438239.164065:0:11663:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9991ffa93000 00000020:00000080:2.0:1789438239.164068:0:11663:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789438239.164154:0:11663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:11663:1876361769704192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789438239.164192:0:11663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438239.164221:0:11663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d04d4480 going to sleep for 11 seconds 00000100:00100000:3.0:1789438239.164343:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769704192 00000100:00100000:3.0:1789438239.164348:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769704192 00000100:00100000:3.0:1789438239.164371:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789438239.164378:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+17:11663:x1876361769704192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789438239.164601:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+17:11663:x1876361769704192:12345-0@lo:502:llog_process_th.0 Request processed in 222us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438239.164608:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789438239.166124:0:11663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:11663:1876361769704192:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789438239.166171:0:11663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789438239.166179:0:11663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789438239.166181:0:11663:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789438239.166185:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789438239.166982:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789438239.167007:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789438239.167017:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991e74f1e00/0x7a8dd0fcbb924f18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924f1f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438239.167030:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991e74f1e00/0x7a8dd0fcbb924f18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924f1f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789438239.167041:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789438239.167043:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9991d08f6800 from 7 10000000:01000000:0.0:1789438239.167046:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789438239.167079:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991f3d62400/0x7a8dd0fcbb924f26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438239.167087:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991f3d62400/0x7a8dd0fcbb924f26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438239.167097:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991f3d62400/0x7a8dd0fcbb924f26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438239.167129:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa748700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769704320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789438239.167205:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438239.167239:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c5e00600 going to sleep for 11 seconds 00000100:00100000:3.0:1789438239.167737:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769704320 00000100:00100000:3.0:1789438239.167746:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769704320 00000100:00100000:3.0:1789438239.168751:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789438239.168766:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+17:5836:x1876361769704320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789438239.169306:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438239.169327:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c2a55c00/0x7a8dd0fcbb924f2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924f26 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438239.169354:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c2a55c00/0x7a8dd0fcbb924f2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924f26 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438239.169376:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c2a55c00/0x7a8dd0fcbb924f2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924f26 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438239.169385:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a55c00, rc 0) 00000100:00100000:3.0:1789438239.169535:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769704320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 773us (2329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438239.169542:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789438239.169605:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa748700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769704320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789438239.169921:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991f3d62400/0x7a8dd0fcbb924f26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924f2d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438239.169932:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991f3d62400/0x7a8dd0fcbb924f26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924f2d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438239.170009:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fabcb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769704448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789438239.170052:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438239.170146:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fabaa0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789438239.173096:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769704448 00000100:00100000:2.0:1789438239.173110:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769704448 00000100:00100000:2.0:1789438239.173161:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789438239.173171:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769704448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789438239.174041:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769704448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 867us (3984us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438239.174051:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789438239.174120:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fabcb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769704448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789438239.174173:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769704576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789438239.174224:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438239.174267:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d04d4840 going to sleep for 11 seconds 00000100:00100000:2.0:1789438239.174297:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769704576 00000100:00100000:2.0:1789438239.174303:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769704576 00000100:00100000:2.0:1789438239.174561:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789438239.174573:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769704576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789438239.174752:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769704576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438239.174760:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789438239.174811:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769704576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789438239.175014:0:11665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:11665:1876361769704704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789438239.175053:0:11665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438239.175071:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769704704 00000100:00100000:2.0:1789438239.175074:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769704704 00000100:00100000:2.0:1789438239.175094:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789438239.175101:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+18:11665:x1876361769704704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789438239.175212:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+18:11665:x1876361769704704:12345-0@lo:502:llog_process_th.0 Request processed in 112us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438239.175218:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789438239.175256:0:11665:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d04d4240 going to sleep for 11 seconds 00000100:00100000:2.0:1789438239.175267:0:11665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:11665:1876361769704704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789438239.175286:0:11665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789438239.175295:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789438239.175297:0:11665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789438239.175303:0:11665:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9991d08f6800 00000020:00000080:2.0:1789438239.175306:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789438239.175954:0:11665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:11665:1876361769704832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789438239.175997:0:11665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438239.176018:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769704832 00000100:00100000:2.0:1789438239.176022:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769704832 00000100:00100000:2.0:1789438239.176044:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789438239.176050:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+18:11665:x1876361769704832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789438239.176174:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+18:11665:x1876361769704832:12345-0@lo:502:llog_process_th.0 Request processed in 124us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438239.176181:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789438239.176212:0:11665:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d04d4240 going to sleep for 11 seconds 00000100:00100000:2.0:1789438239.176228:0:11665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:11665:1876361769704832:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789438239.176264:0:11665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789438239.176269:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789438239.176270:0:11665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789438239.176274:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789438239.176321:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789438239.176349:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789438239.176358:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991f3d62400/0x7a8dd0fcbb924f26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924f2d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438239.176369:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991f3d62400/0x7a8dd0fcbb924f26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924f2d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789438239.176547:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789438239.176549:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9991d197a000 from 7 10000000:01000000:2.0:1789438239.176552:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789438239.176576:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991e74f0200/0x7a8dd0fcbb924f34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438239.176586:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991e74f0200/0x7a8dd0fcbb924f34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438239.176595:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991e74f0200/0x7a8dd0fcbb924f34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438239.176609:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769704960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789438239.176634:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438239.176648:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d04d4240 going to sleep for 11 seconds 00000100:00100000:2.0:1789438239.176660:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769704960 00000100:00100000:2.0:1789438239.176662:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769704960 00000100:00100000:2.0:1789438239.176682:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789438239.176693:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+18:5836:x1876361769704960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789438239.176701:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438239.176897:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991e74f1200/0x7a8dd0fcbb924f3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb924f34 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438239.176919:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991e74f1200/0x7a8dd0fcbb924f3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924f34 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438239.176930:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991e74f1200/0x7a8dd0fcbb924f3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb924f34 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438239.176938:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f1200, rc 0) 00000100:00100000:2.0:1789438239.176973:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:5836:x1876361769704960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 281us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438239.176979:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789438239.177009:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769704960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789438239.177020:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991e74f0200/0x7a8dd0fcbb924f34 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924f3b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438239.177029:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991e74f0200/0x7a8dd0fcbb924f34 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924f3b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438239.177068:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769705088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789438239.177089:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438239.177100:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d04d4240 going to sleep for 11 seconds 00000100:00100000:2.0:1789438239.177519:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769705088 00000100:00100000:2.0:1789438239.177525:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769705088 00000100:00100000:2.0:1789438239.177559:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789438239.177575:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1facc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:5836:x1876361769705088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789438239.177836:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1facc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:5836:x1876361769705088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438239.177843:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789438239.177881:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769705088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789438239.177914:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769705216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789438239.177950:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438239.177962:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d04d4240 going to sleep for 11 seconds 00000100:00100000:2.0:1789438239.177972:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769705216 00000100:00100000:2.0:1789438239.177975:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769705216 00000100:00100000:2.0:1789438239.177992:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789438239.177997:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:5836:x1876361769705216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789438239.178112:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:5836:x1876361769705216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438239.178119:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789438239.178152:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7073a0da-08cf-42fe-8791-a8c6139408f2:5836:1876361769705216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789438239.179554:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:11667:1876361769705344:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789438239.179614:0:11667:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438239.179648:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769705344 00000100:00100000:2.0:1789438239.179652:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769705344 00000100:00100000:2.0:1789438239.179679:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789438239.179686:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:11667:x1876361769705344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789438239.179850:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:11667:x1876361769705344:12345-0@lo:502:llog_process_th.0 Request processed in 164us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438239.179865:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789438239.179899:0:11667:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d04d4600 going to sleep for 11 seconds 00000100:00100000:2.0:1789438239.179917:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:11667:1876361769705344:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789438239.179939:0:11667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789438239.179948:0:11667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789438239.179950:0:11667:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789438239.179955:0:11667:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9991d197a000 00000020:00000080:2.0:1789438239.179958:0:11667:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789438239.180508:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:11667:1876361769705472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789438239.180553:0:11667:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438239.180593:0:11667:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c6d5d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789438239.180743:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769705472 00000100:00100000:0.0:1789438239.180749:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769705472 00000100:00100000:0.0:1789438239.180788:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789438239.180796:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:11667:x1876361769705472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789438239.180963:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:11667:x1876361769705472:12345-0@lo:502:llog_process_th.0 Request processed in 168us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438239.180970:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789438239.181144:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7073a0da-08cf-42fe-8791-a8c6139408f2:11667:1876361769705472:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789438239.181168:0:11667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789438239.181174:0:11667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789438239.181176:0:11667:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789438239.181181:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789438239.181341:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789438239.181361:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789438239.181371:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991e74f0200/0x7a8dd0fcbb924f34 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924f3b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438239.181383:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991e74f0200/0x7a8dd0fcbb924f34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924f3b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789438239.195037:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789438239.453368:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438239.454597:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749746944 00000100:00100000:0.0:1789438239.454610:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749746944 00000100:00100000:0.0:1789438239.454683:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 262 00000100:00100000:0.0:1789438239.454694:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+11:5595:x1876361749746944:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789438239.454747:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438239.454778:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991f3d62a00/0x7a8dd0fcbb924f42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x483b483084eaa196 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438239.454809:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991f3d62a00/0x7a8dd0fcbb924f42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa196 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438239.454840:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991f3d62a00/0x7a8dd0fcbb924f42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa196 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438239.454849:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d62a00, rc 0) 00000100:00100000:0.0:1789438239.454907:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+12:5595:x1876361749746944:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 Request processed in 215us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438239.454915:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 262 00000100:00100000:2.0:1789438239.458065:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438239.467059:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749747072 00000100:00100000:0.0:1789438239.467090:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749747072 00000100:00100000:0.0:1789438239.467331:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 263 00000100:00100000:0.0:1789438239.467346:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+12:5595:x1876361749747072:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789438239.468774:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+12:5595:x1876361749747072:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 Request processed in 1421us (10710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438239.477565:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 263 00000100:00100000:1.0:1789438239.480916:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438239.481013:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749747200 00000100:00100000:2.0:1789438239.481034:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749747200 00000100:00100000:2.0:1789438239.481171:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 264 00000100:00100000:2.0:1789438239.481182:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+12:5595:x1876361749747200:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789438239.481494:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+12:5595:x1876361749747200:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 Request processed in 313us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438239.481503:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 264 00000100:00100000:3.0:1789438239.498202:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438239.498422:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749747328 00000100:00100000:0.0:1789438239.498434:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749747328 00000100:00100000:0.0:1789438239.499849:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 265 00000100:00100000:0.0:1789438239.499873:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+12:9968:x1876361749747328:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789438239.500199:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+12:9968:x1876361749747328:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 337us (2011us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438239.500208:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 265 00000100:00100000:3.0:1789438239.508078:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438239.508188:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749747456 00000100:00100000:2.0:1789438239.508200:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749747456 00000100:00100000:2.0:1789438239.508282:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 266 00000100:00100000:2.0:1789438239.508292:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+12:9968:x1876361749747456:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789438239.508631:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+12:9968:x1876361749747456:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 340us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438239.508648:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 266 00000100:00100000:1.0:1789438239.518956:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438239.519091:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749747584 00000100:00100000:0.0:1789438239.519105:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749747584 00000100:00100000:0.0:1789438239.519180:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 267 00000100:00100000:0.0:1789438239.519192:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+12:5595:x1876361749747584:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789438239.519229:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438239.519265:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991f3d62e00/0x7a8dd0fcbb924f49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x483b483084eaa19d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438239.519302:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991f3d62e00/0x7a8dd0fcbb924f49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa19d expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438239.519330:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991f3d62e00/0x7a8dd0fcbb924f49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa19d expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438239.519340:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d62e00, rc 0) 00000100:00100000:0.0:1789438239.519422:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+13:5595:x1876361749747584:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 Request processed in 233us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438239.519430:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 267 00000100:00100000:3.0:1789438239.526688:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438239.526952:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749747712 00000100:00100000:0.0:1789438239.526965:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749747712 00000100:00100000:0.0:1789438239.527098:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 268 00000100:00100000:0.0:1789438239.527110:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+13:5595:x1876361749747712:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789438239.527490:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+13:5595:x1876361749747712:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 Request processed in 382us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438239.527499:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 268 00000100:00100000:1.0:1789438239.531765:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438239.531871:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749747840 00000100:00100000:2.0:1789438239.531887:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749747840 00000100:00100000:2.0:1789438239.531959:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 269 00000100:00100000:2.0:1789438239.531969:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+13:5595:x1876361749747840:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789438239.532349:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+13:5595:x1876361749747840:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 Request processed in 381us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438239.532358:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 269 00000100:00100000:1.0:1789438239.546214:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438239.546763:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749747968 00000100:00100000:2.0:1789438239.546776:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749747968 00000100:00100000:2.0:1789438239.546850:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 270 00000100:00100000:2.0:1789438239.546863:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+13:9971:x1876361749747968:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789438239.547336:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+13:9971:x1876361749747968:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 473us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438239.547345:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 270 00000100:00100000:1.0:1789438239.561355:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438239.561467:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749748096 00000100:00100000:0.0:1789438239.561479:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749748096 00000100:00100000:0.0:1789438239.561670:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 271 00000100:00100000:0.0:1789438239.561685:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+13:9971:x1876361749748096:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789438239.562086:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+13:9971:x1876361749748096:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 393us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438239.566211:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 271 00010000:00010000:0.0:1789438239.606818:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438240.216182:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438240.216757:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749748224 00000100:00100000:3.0:1789438240.216770:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749748224 00000100:00100000:3.0:1789438240.216875:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 102 00000100:00100000:3.0:1789438240.216887:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+5:2354:x1876361749748224:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438240.216990:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+5:2354:x1876361749748224:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 106us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438240.216999:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 102 00000100:00080000:0.0:1789438240.217092:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789438240.221465:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438240.221515:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438240.222015:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749748352 00000100:00100000:3.0:1789438240.222028:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749748352 00000100:00100000:3.0:1789438240.222119:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 58 00000100:00100000:3.0:1789438240.222131:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1274be99-2d57-4dac-a13e-a89426512ee0+5:2354:x1876361749748352:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438240.222250:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1274be99-2d57-4dac-a13e-a89426512ee0+5:2354:x1876361749748352:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 112us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438240.222258:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 58 00000100:00080000:1.0:1789438240.223268:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789438240.228164:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749748480 00000100:00100000:0.0:1789438240.228196:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749748480 00000100:00100000:0.0:1789438240.228322:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 103 00000100:00100000:0.0:1789438240.228334:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2354:x1876361749748480:12345-192.168.206.9@tcp:400:kworker.0 00000100:00080000:1.0:1789438240.228879:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789438240.229025:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2354:x1876361749748480:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 690us (7506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438240.229035:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 103 00000040:00080000:2.0:1789438240.249151:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789438240.635699:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438241.655427:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438242.678907:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438243.130648:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769705984:0@lo:400:kworker.0 00000100:00100000:1.0:1789438243.130648:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876361769705728:0@lo:400:kworker.0 00000100:00100000:0.0:1789438243.131186:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876361769705856:0@lo:400:kworker.0 00000100:00100000:2.0:1789438243.131261:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769705600:0@lo:400:kworker.0 00000100:00100000:1.0:1789438243.137280:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438243.137377:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769706240:0@lo:400:kworker.0 00000100:00100000:1.0:1789438243.137413:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438243.137822:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769705728 00000100:00100000:1.0:1789438243.137831:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769705728 00000100:00100000:1.0:1789438243.137882:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789438243.137890:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876361769705728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438243.137949:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876361769705728:12345-0@lo:400:kworker.0 Request processed in 59us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438243.137956:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789438243.142366:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876361769705728:0@lo:400:kworker.0 00000100:00100000:1.0:1789438243.142496:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769706240 00000100:00100000:1.0:1789438243.142505:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769706240 00000100:00100000:1.0:1789438243.142564:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789438243.142573:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa644700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1876361769706240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438243.142671:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa644700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1876361769706240:12345-0@lo:400:kworker.0 Request processed in 99us (5255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438243.142679:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1789438243.142698:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789438243.142741:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769706240:0@lo:400:kworker.0 00000100:00100000:3.0:1789438243.143991:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438243.153074:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438243.153197:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769705600 00000100:00100000:2.0:1789438243.153207:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769705600 00000100:00100000:2.0:1789438243.153395:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789438243.153407:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3310:x1876361769705600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438243.153480:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3310:x1876361769705600:12345-0@lo:400:kworker.0 Request processed in 76us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438243.153820:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789438243.153909:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769705600:0@lo:400:kworker.0 00000100:00100000:2.0:1789438243.153923:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876361769706112:0@lo:400:kworker.0 00000100:00100000:2.0:1789438243.154479:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438243.154981:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438243.155020:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769706112 00000100:00100000:0.0:1789438243.155028:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769706112 00000100:00100000:0.0:1789438243.155081:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769705856 00000100:00100000:0.0:1789438243.155085:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769705856 00000100:00100000:0.0:1789438243.155112:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789438243.155122:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876361769706112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438243.155182:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876361769706112:12345-0@lo:400:kworker.0 Request processed in 62us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438243.155189:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789438243.155205:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789438243.155211:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa74ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876361769705856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438243.155255:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa74ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876361769705856:12345-0@lo:400:kworker.0 Request processed in 44us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438243.155270:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1789438243.155289:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789438243.155321:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876361769705856:0@lo:400:kworker.0 00000100:00100000:0.0:1789438243.155476:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769705984 00000100:00100000:0.0:1789438243.155481:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769705984 00000100:00100000:0.0:1789438243.155515:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789438243.155535:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769705984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438243.155572:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769705984:12345-0@lo:400:kworker.0 Request processed in 51us (11587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438243.155579:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1789438243.155592:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789438243.155699:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876361769706112:0@lo:400:kworker.0 00010000:00080000:3.0:1789438243.159737:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff86e300 x1876361769705984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438243.159830:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769705984:0@lo:400:kworker.0 00000001:00080000:3.0:1789438243.224183:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:0.0:1789438243.639000:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff953b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769706368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789438243.639072:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438243.639275:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769706368 00000100:00100000:3.0:1789438243.639284:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769706368 00000100:00100000:3.0:1789438243.639338:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789438243.639348:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa74a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769706368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789438243.639394:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789438243.639461:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa74a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769706368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438243.639468:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789438243.639752:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1789438243.639758:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9991fa74a680, transno 4294967300 00000100:00100000:0.0:1789438243.639784:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff953b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769706368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789438243.641605:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769706496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789438243.641671:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438243.643935:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769706496 00000100:00100000:0.0:1789438243.643950:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769706496 00000100:00100000:0.0:1789438243.644020:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789438243.644031:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769706496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789438243.644067:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438243.644157:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769706496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (2484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438243.644164:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1789438243.644361:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff951c00 x1876361769706496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438259 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438243.644399:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769706496:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789438243.702951:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438244.726892:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438245.336402:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438245.336443:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438245.336476:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438245.336518:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438245.336650:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749748864 00000100:00100000:3.0:1789438245.336662:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749748864 00000100:00100000:2.0:1789438245.336746:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749748736 00000100:00100000:2.0:1789438245.336752:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749748736 00000100:00100000:3.0:1789438245.336769:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 61 00000100:00100000:3.0:1789438245.336782:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1274be99-2d57-4dac-a13e-a89426512ee0+5:2353:x1876361749748864:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789438245.336787:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749748992 00000100:00100000:2.0:1789438245.336791:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749748992 00000100:00100000:2.0:1789438245.336817:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 107 00000100:00100000:2.0:1789438245.336825:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+5:2353:x1876361749748736:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438245.336865:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1274be99-2d57-4dac-a13e-a89426512ee0+5:2353:x1876361749748864:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 86us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438245.336868:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+5:2353:x1876361749748736:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 42us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438245.336880:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 61 00000100:00100000:2.0:1789438245.336881:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 107 00000100:00100000:2.0:1789438245.336906:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 108 00000100:00100000:2.0:1789438245.336914:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2353:x1876361749748992:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789438245.336940:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2353:x1876361749748992:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 27us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438245.336946:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 108 00000100:00100000:0.0:1789438245.336964:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749748608 00000100:00100000:0.0:1789438245.336969:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749748608 00000100:00100000:0.0:1789438245.337013:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 273 00000100:00100000:0.0:1789438245.337021:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+13:2353:x1876361749748608:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789438245.337047:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+13:2353:x1876361749748608:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 28us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438245.337053:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 273 00000100:00080000:2.0:1789438245.337092:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789438245.337119:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789438245.751231:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438246.775453:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438247.798951:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438248.251620:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769706624:0@lo:400:kworker.0 00000100:00100000:2.0:1789438248.251697:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438248.251775:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876361769707136:0@lo:400:kworker.0 00000100:00100000:2.0:1789438248.251805:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438248.251833:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789438248.251839:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769707008:0@lo:400:kworker.0 00000100:00100000:2.0:1789438248.251862:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438248.251888:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876361769706752:0@lo:400:kworker.0 00000100:00100000:2.0:1789438248.251910:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438248.251924:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769707264:0@lo:400:kworker.0 00000100:00100000:2.0:1789438248.251973:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438248.251995:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789438248.252000:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769706880:0@lo:400:kworker.0 00000100:00100000:2.0:1789438248.252023:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438248.252055:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769706624 00000100:00100000:2.0:1789438248.252063:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769706624 00000100:00100000:2.0:1789438248.252107:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789438248.252116:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3310:x1876361769706624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438248.252165:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3310:x1876361769706624:12345-0@lo:400:kworker.0 Request processed in 50us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438248.252172:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789438248.252216:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769707136 00000100:00100000:2.0:1789438248.252220:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769707136 00000100:00100000:2.0:1789438248.252251:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769706752 00000100:00100000:2.0:1789438248.252253:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769706752 00000100:00100000:2.0:1789438248.252264:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769706880 00000100:00100000:2.0:1789438248.252273:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769706880 00000100:00100000:2.0:1789438248.252293:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789438248.252299:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876361769707136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438248.252332:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876361769707136:12345-0@lo:400:kworker.0 Request processed in 33us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438248.252337:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789438248.252348:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789438248.252353:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876361769706752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438248.252382:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876361769706752:12345-0@lo:400:kworker.0 Request processed in 29us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438248.252387:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789438248.252397:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789438248.252403:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d05d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769706880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438248.252427:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d05d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769706880:12345-0@lo:400:kworker.0 Request processed in 25us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438248.252432:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789438248.252450:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769707008 00000100:00100000:2.0:1789438248.252453:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769707008 00000100:00100000:2.0:1789438248.252479:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769707264 00000100:00100000:2.0:1789438248.252482:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769707264 00000100:00100000:2.0:1789438248.252501:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789438248.252506:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769707008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438248.252537:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769707008:12345-0@lo:400:kworker.0 Request processed in 31us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438248.252543:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789438248.252553:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789438248.252558:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d05d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769707264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438248.252593:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d05d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769707264:12345-0@lo:400:kworker.0 Request processed in 35us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438248.252599:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1789438248.252635:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789438248.252639:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789438248.252641:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789438248.252670:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769706880:0@lo:400:kworker.0 00000100:00100000:2.0:1789438248.252682:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876361769706752:0@lo:400:kworker.0 00000100:00100000:2.0:1789438248.252691:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769707264:0@lo:400:kworker.0 00010000:00080000:2.0:1789438248.252746:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991d06b0a80 x1876361769707008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438248.252756:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769707008:0@lo:400:kworker.0 00000100:00100000:2.0:1789438248.252765:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769706624:0@lo:400:kworker.0 00000100:00100000:2.0:1789438248.252774:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876361769707136:0@lo:400:kworker.0 00000100:00100000:1.0:1789438248.760218:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789438248.760245:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769707392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789438248.760336:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438248.760471:0:10069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769707392 00000100:00100000:1.0:1789438248.760480:0:10069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769707392 00000100:00100000:1.0:1789438248.760528:0:10069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789438248.760537:0:10069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa644000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769707392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789438248.760573:0:10069:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789438248.760618:0:10069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa644000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769707392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438248.760624:0:10069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789438248.760672:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769707392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789438248.761258:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff952680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769707520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789438248.761296:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438248.761334:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769707520 00000100:00100000:3.0:1789438248.761340:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769707520 00000100:00100000:3.0:1789438248.761368:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789438248.761376:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769707520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789438248.761399:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789438248.761433:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769707520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438248.761440:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1789438248.761471:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff952680 x1876361769707520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438248.761486:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff952680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769707520:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789438248.822874:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438249.846996:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438250.455665:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438250.455744:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438250.455886:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438250.455929:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438250.455972:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749749376 00000100:00100000:3.0:1789438250.455981:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749749376 00000100:00100000:3.0:1789438250.456042:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 64 00000100:00100000:3.0:1789438250.456053:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff952d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1274be99-2d57-4dac-a13e-a89426512ee0+5:2355:x1876361749749376:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438250.456120:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff952d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1274be99-2d57-4dac-a13e-a89426512ee0+5:2355:x1876361749749376:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 69us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438250.456129:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 64 00000100:00080000:3.0:1789438250.456167:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789438250.457152:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749749120 00000100:00100000:1.0:1789438250.457163:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749749120 00000100:00100000:1.0:1789438250.457228:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 275 00000100:00100000:1.0:1789438250.457237:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+13:2355:x1876361749749120:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438250.457284:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+13:2355:x1876361749749120:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 48us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438250.457290:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 275 00000100:00100000:0.0:1789438250.457593:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749749248 00000100:00100000:0.0:1789438250.457598:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749749248 00000100:00100000:0.0:1789438250.457778:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749749504 00000100:00100000:0.0:1789438250.457782:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749749504 00000100:00100000:3.0:1789438250.457831:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 112 00000100:00100000:3.0:1789438250.457841:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+5:2355:x1876361749749248:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438250.457882:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+5:2355:x1876361749749248:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 43us (2227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438250.457889:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 112 00000100:00080000:1.0:1789438250.458024:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789438250.458128:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 113 00000100:00100000:0.0:1789438250.458137:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2355:x1876361749749504:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789438250.458171:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2355:x1876361749749504:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 36us (2427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438250.458178:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 113 00000040:00080000:2.0:1789438250.487501:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789438250.871285:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438251.894883:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438252.920149:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438253.371244:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff953800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769708032:0@lo:400:kworker.0 00000100:00100000:3.0:1789438253.371315:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438253.371377:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789438253.371384:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769707648:0@lo:400:kworker.0 00000100:00100000:3.0:1789438253.371414:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438253.371436:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff953100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876361769708160:0@lo:400:kworker.0 00000100:00100000:3.0:1789438253.371461:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438253.371494:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769708160 00000100:00100000:3.0:1789438253.371514:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769708160 00000100:00100000:3.0:1789438253.371565:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789438253.371574:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876361769708160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438253.371628:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876361769708160:12345-0@lo:400:kworker.0 Request processed in 55us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438253.371635:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789438253.371674:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff953100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876361769708160:0@lo:400:kworker.0 00000100:00100000:1.0:1789438253.371866:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff951880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876361769707776:0@lo:400:kworker.0 00000100:00100000:1.0:1789438253.371899:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438253.371930:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769708288:0@lo:400:kworker.0 00000100:00100000:1.0:1789438253.371952:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438253.371968:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789438253.371973:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769707904:0@lo:400:kworker.0 00000100:00100000:1.0:1789438253.372005:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789438253.372032:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789438253.372044:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769707776 00000100:00100000:1.0:1789438253.372048:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769707776 00000100:00100000:1.0:1789438253.372072:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769707904 00000100:00100000:1.0:1789438253.372075:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769707904 00000100:00100000:1.0:1789438253.372095:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789438253.372101:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876361769707776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438253.372150:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876361769707776:12345-0@lo:400:kworker.0 Request processed in 48us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438253.372156:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789438253.372168:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789438253.372193:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769707904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438253.372221:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769707904:12345-0@lo:400:kworker.0 Request processed in 47us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438253.372226:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:1.0:1789438253.372240:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789438253.372526:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769707904:0@lo:400:kworker.0 00000100:00100000:1.0:1789438253.372537:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff951880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876361769707776:0@lo:400:kworker.0 00000100:00100000:2.0:1789438253.372932:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769708032 00000100:00100000:2.0:1789438253.372938:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769708032 00000100:00100000:2.0:1789438253.372991:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769708288 00000100:00100000:2.0:1789438253.372994:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769708288 00000100:00100000:2.0:1789438253.373017:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789438253.373024:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769708032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438253.373076:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769708032:12345-0@lo:400:kworker.0 Request processed in 53us (1761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438253.373082:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789438253.373121:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789438253.373128:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769708288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438253.373161:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769708288:12345-0@lo:400:kworker.0 Request processed in 34us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438253.373167:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789438253.373203:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769707648 00000100:00100000:2.0:1789438253.373208:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769707648 00000100:00100000:2.0:1789438253.373230:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789438253.373236:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3309:x1876361769707648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438253.373264:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3309:x1876361769707648:12345-0@lo:400:kworker.0 Request processed in 28us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438253.373270:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789438253.373319:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769707648:0@lo:400:kworker.0 00010000:00080000:2.0:1789438253.373333:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff953800 x1876361769708032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438253.373345:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff953800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769708032:0@lo:400:kworker.0 00000100:00080000:0.0:1789438253.373491:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789438253.373496:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789438253.374071:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769708288:0@lo:400:kworker.0 00000100:00100000:3.0:1789438253.879272:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789438253.879298:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff953100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769708416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789438253.879366:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438253.879441:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769708416 00000100:00100000:3.0:1789438253.879450:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769708416 00000100:00100000:3.0:1789438253.879797:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789438253.879808:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769708416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789438253.879840:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789438253.879887:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789438253.879889:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769708416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438253.879896:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789438253.879898:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa74b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769708544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789438253.879952:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff953100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769708416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789438253.887746:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438253.888419:0:10069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769708544 00000100:00100000:3.0:1789438253.888430:0:10069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769708544 00000100:00100000:1.0:1789438253.888647:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789438253.888660:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d05d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769708544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789438253.888700:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789438253.888797:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d05d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769708544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438253.888821:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1789438253.890594:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991fa74b100 x1876361769708544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438253.890621:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa74b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769708544:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789438253.942867:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438254.967289:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438255.576654:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438255.576791:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438255.577235:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749749760 00000100:00100000:2.0:1789438255.577247:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749749760 00000100:00100000:2.0:1789438255.577345:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 117 00000100:00100000:2.0:1789438255.577366:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+5:2356:x1876361749749760:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789438255.577447:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+5:2356:x1876361749749760:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 84us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438255.577455:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 117 00000100:00080000:0.0:1789438255.577674:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789438255.583277:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749749632 00000100:00100000:3.0:1789438255.583294:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749749632 00000100:00100000:3.0:1789438255.583369:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 277 00000100:00100000:3.0:1789438255.583381:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+13:2356:x1876361749749632:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438255.583476:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+13:2356:x1876361749749632:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 98us (6831us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438255.583511:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 277 00000100:00100000:1.0:1789438255.608917:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438255.608962:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438255.609020:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749750016 00000100:00100000:0.0:1789438255.609031:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749750016 00000100:00100000:0.0:1789438255.609104:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 118 00000100:00100000:2.0:1789438255.609127:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749749888 00000100:00100000:0.0:1789438255.609128:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2356:x1876361749750016:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789438255.609131:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749749888 00000100:00100000:2.0:1789438255.609180:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 19 00000100:00100000:2.0:1789438255.609188:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1274be99-2d57-4dac-a13e-a89426512ee0+5:2352:x1876361749749888:12345-192.168.206.9@tcp:9:kworker.0 00000020:00000080:2.0:1789438255.609208:0:6681:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924e85 00000100:00080000:2.0:1789438255.609218:0:6681:0:(import.c:65:import_set_state_nolock()) ffff9991fa636800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789438255.609220:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2356:x1876361749750016:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 95us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438255.609226:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 118 00000001:00000004:2.0:1789438255.609255:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:1.0:1789438255.609410:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789438255.609415:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789438255.609422:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438255.609512:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1274be99-2d57-4dac-a13e-a89426512ee0+2:2352:x1876361749749888:12345-192.168.206.9@tcp:9:kworker.0 Request processed in 324us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438255.609520:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 19 00010000:00010000:0.0:1789438255.991988:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438257.014886:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438258.039033:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438258.487427:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769708672:0@lo:400:kworker.0 00000100:00100000:3.0:1789438258.487435:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876361769708800:0@lo:400:kworker.0 00000100:00100000:3.0:1789438258.489738:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438258.489820:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f47db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769709312:0@lo:400:kworker.0 00000100:00100000:3.0:1789438258.489856:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438258.489896:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789438258.489904:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769708928:0@lo:400:kworker.0 00000100:00100000:3.0:1789438258.489926:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438258.489966:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769709312 00000100:00100000:3.0:1789438258.489975:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769709312 00000100:00100000:3.0:1789438258.490036:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789438258.490045:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff950380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769709312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438258.490101:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff950380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769709312:12345-0@lo:400:kworker.0 Request processed in 58us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438258.490109:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789438258.490132:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769708800 00000100:00100000:3.0:1789438258.490136:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769708800 00000100:00100000:3.0:1789438258.490175:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769708928 00000100:00100000:3.0:1789438258.490178:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769708928 00000100:00100000:3.0:1789438258.490198:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789438258.490204:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876361769708800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438258.490234:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876361769708800:12345-0@lo:400:kworker.0 Request processed in 30us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438258.490240:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789438258.490250:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789438258.490255:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769708928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438258.490289:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769708928:12345-0@lo:400:kworker.0 Request processed in 33us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438258.490294:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:3.0:1789438258.490310:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789438258.490314:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789438258.490351:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769708928:0@lo:400:kworker.0 00000100:00100000:3.0:1789438258.490362:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876361769708800:0@lo:400:kworker.0 00000100:00100000:3.0:1789438258.490371:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f47db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769709312:0@lo:400:kworker.0 00000100:00100000:2.0:1789438258.491916:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769709056:0@lo:400:kworker.0 00000100:00100000:2.0:1789438258.491980:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438258.492422:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769709056 00000100:00100000:0.0:1789438258.492431:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769709056 00000100:00100000:0.0:1789438258.492498:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1789438258.492507:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789438258.492511:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d05d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769709056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438258.492580:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d05d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769709056:12345-0@lo:400:kworker.0 Request processed in 73us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438258.492587:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:2.0:1789438258.492602:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991ff86ea00 x1876361769709056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438258.492616:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769709056:0@lo:400:kworker.0 00000100:00100000:1.0:1789438258.494730:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438258.495051:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769708672 00000100:00100000:1.0:1789438258.495059:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769708672 00000100:00100000:1.0:1789438258.495112:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1789438258.495122:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3310:x1876361769708672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438258.495185:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3310:x1876361769708672:12345-0@lo:400:kworker.0 Request processed in 65us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438258.495193:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1789438258.495346:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769708672:0@lo:400:kworker.0 00000100:00100000:1.0:1789438258.495359:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f47d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876361769709184:0@lo:400:kworker.0 00000100:00100000:1.0:1789438258.495390:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438258.495415:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769709184 00000100:00100000:1.0:1789438258.495419:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769709184 00000100:00100000:1.0:1789438258.495458:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789438258.495465:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876361769709184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438258.495496:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876361769709184:12345-0@lo:400:kworker.0 Request processed in 32us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438258.495513:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789438258.495542:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f47d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876361769709184:0@lo:400:kworker.0 00000100:00080000:2.0:1789438258.501555:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1789438258.614506:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1274be99-2d57-4dac-a13e-a89426512ee0 00000020:00000080:3.0:1789438258.614515:0:7628:0:(genops.c:885:class_export_put()) final put ffff9991fa637800/1274be99-2d57-4dac-a13e-a89426512ee0 00000020:00000080:0.0:1789438258.614723:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9991fa637800/1274be99-2d57-4dac-a13e-a89426512ee0 for lustre-OST0001 00000020:00000080:0.0:1789438258.614769:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9991fa636800 for lustre-OST0001 00000100:00100000:3.0:1789438258.998847:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789438258.998873:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff953800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769709440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789438258.998940:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438258.999648:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769709440 00000100:00100000:0.0:1789438258.999657:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769709440 00000100:00100000:0.0:1789438258.999743:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789438258.999754:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769709440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789438258.999793:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438258.999858:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769709440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438258.999868:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789438258.999892:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789438258.999905:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769709568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789438258.999934:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438258.999981:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769709568 00000100:00100000:0.0:1789438258.999985:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769709568 00000100:00100000:0.0:1789438259.000010:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789438259.000016:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa74b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769709568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789438259.000034:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438259.000066:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa74b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769709568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438259.000072:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1789438259.000117:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991fa748e00 x1876361769709568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438259.000135:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769709568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789438259.000179:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff953800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769709440:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789438259.063587:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438260.088696:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438260.695458:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438260.695513:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438260.695551:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438260.695596:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749750400 00000100:00100000:0.0:1789438260.695614:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749750400 00000100:00100000:3.0:1789438260.695644:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749750144 00000100:00100000:3.0:1789438260.695656:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749750144 00000100:00100000:0.0:1789438260.695738:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749750272 00000100:00100000:0.0:1789438260.695745:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749750272 00000100:00100000:3.0:1789438260.695773:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 279 00000100:00100000:3.0:1789438260.695790:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+13:2355:x1876361749750144:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789438260.695803:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 122 00000100:00100000:0.0:1789438260.695818:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d05d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2355:x1876361749750400:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438260.695902:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+13:2355:x1876361749750144:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 116us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438260.695922:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 279 00000100:00100000:0.0:1789438260.695925:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d05d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2355:x1876361749750400:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 99us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438260.695937:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 122 00000100:00100000:0.0:1789438260.695964:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 123 00000100:00100000:0.0:1789438260.695976:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d05d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+5:2355:x1876361749750272:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789438260.696008:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d05d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+5:2355:x1876361749750272:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 36us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438260.696021:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 123 00000100:00080000:2.0:1789438260.704639:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1789438260.729591:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789438261.111002:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438262.134881:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789438262.604461:0:11830:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 22:11:00 (1789438260) 00010000:00010000:0.0:1789438263.159214:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438263.607075:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d05d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876361769709824:0@lo:400:kworker.0 00000100:00100000:2.0:1789438263.607156:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438263.607215:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d05d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769710336:0@lo:400:kworker.0 00000100:00100000:2.0:1789438263.607244:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438263.607275:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789438263.607281:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d05d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769709952:0@lo:400:kworker.0 00000100:00100000:2.0:1789438263.607302:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438263.607405:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769709824 00000100:00100000:2.0:1789438263.607413:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769709824 00000100:00100000:2.0:1789438263.607458:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769709952 00000100:00100000:2.0:1789438263.607462:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769709952 00000100:00100000:2.0:1789438263.607491:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789438263.607501:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d05d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876361769709824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438263.607556:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d05d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876361769709824:12345-0@lo:400:kworker.0 Request processed in 56us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438263.607564:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789438263.607596:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789438263.607602:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d05d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769709952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438263.607630:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d05d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769709952:12345-0@lo:400:kworker.0 Request processed in 29us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438263.607636:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:2.0:1789438263.607662:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789438263.607695:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d05d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769709952:0@lo:400:kworker.0 00000100:00100000:2.0:1789438263.607753:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d05d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876361769709824:0@lo:400:kworker.0 00000100:00100000:1.0:1789438263.607849:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d05d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769710080:0@lo:400:kworker.0 00000100:00100000:1.0:1789438263.607881:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438263.607910:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789438263.607917:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d05d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769709696:0@lo:400:kworker.0 00000100:00100000:1.0:1789438263.607943:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438263.607966:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d05d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876361769710208:0@lo:400:kworker.0 00000100:00100000:1.0:1789438263.607992:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438263.608018:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769709696 00000100:00100000:1.0:1789438263.608022:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769709696 00000100:00100000:1.0:1789438263.608053:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1789438263.608060:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3309:x1876361769709696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438263.608097:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3309:x1876361769709696:12345-0@lo:400:kworker.0 Request processed in 37us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438263.608102:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1789438263.608146:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d05d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769709696:0@lo:400:kworker.0 00000100:00100000:1.0:1789438263.608163:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769710208 00000100:00100000:1.0:1789438263.608167:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769710208 00000100:00100000:1.0:1789438263.608195:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789438263.608201:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876361769710208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438263.608234:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876361769710208:12345-0@lo:400:kworker.0 Request processed in 32us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438263.608254:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:1.0:1789438263.608270:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789438263.608288:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d05d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876361769710208:0@lo:400:kworker.0 00000100:00100000:2.0:1789438263.610510:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769710336 00000100:00100000:2.0:1789438263.610525:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769710336 00000100:00100000:2.0:1789438263.610621:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769710080 00000100:00100000:2.0:1789438263.610626:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769710080 00000100:00100000:2.0:1789438263.610654:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789438263.610665:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d05d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769710336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438263.610779:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d05d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769710336:12345-0@lo:400:kworker.0 Request processed in 117us (3534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438263.610787:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789438263.610813:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789438263.610819:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769710080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438263.610851:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769710080:12345-0@lo:400:kworker.0 Request processed in 33us (2968us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438263.610856:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789438263.610907:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d05d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769710336:0@lo:400:kworker.0 00010000:00080000:1.0:1789438263.614086:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991d05d6680 x1876361769710080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789438279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789438263.614105:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d05d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769710080:0@lo:400:kworker.0 00000100:00080000:0.0:1789438263.614982:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789438263.614988:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789438264.118945:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769710464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789438264.119039:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438264.119221:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769710464 00000100:00100000:0.0:1789438264.119230:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769710464 00000100:00100000:0.0:1789438264.119281:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789438264.119291:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d05d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769710464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789438264.119327:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789438264.119655:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789438264.119669:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff951880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769710592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789438264.119700:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438264.119783:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769710592 00000100:00100000:3.0:1789438264.119787:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769710592 00000100:00100000:3.0:1789438264.119823:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789438264.119830:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff950e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769710592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789438264.119851:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789438264.119887:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff950e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769710592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438264.119895:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789438264.119944:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff951880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769710592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789438264.123683:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d05d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769710464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4382us (4641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438264.123699:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1789438264.132252:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991fa748e00 x1876361769710464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438264.132281:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769710464:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789438264.184146:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438264.294631:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438264.294801:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749750528 00000100:00100000:2.0:1789438264.294812:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749750528 00000100:00100000:2.0:1789438264.294891:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 32 00000100:00100000:2.0:1789438264.294903:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa74a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+5:10239:x1876361749750528:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789438264.294925:0:7624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438264.294950:0:7624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb924f50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa1a4 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789438264.295051:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789438264.295139:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924f57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.295154:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924f57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.295168:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924f57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438264.295204:0:7624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789438264.295208:0:7624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789438264.295249:0:7624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924f57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.295348:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb924f50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1a4 expref: 7 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.295367:0:7624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924f57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1a4 expref: 6 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.295375:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872a00) 00010000:00010000:2.0:1789438264.295378:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789438264.295382:0:7624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f0a00, rc 0) 00000100:00100000:2.0:1789438264.298590:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa74a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+6:10239:x1876361749750528:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 3677us (3956us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438264.298603:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 32 00000100:00100000:0.0:1789438264.307911:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438264.308626:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749750656 00000100:00100000:1.0:1789438264.308639:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749750656 00000100:00100000:1.0:1789438264.308751:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 33 00000100:00100000:1.0:1789438264.308764:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+6:10240:x1876361749750656:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789438264.308786:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438264.308808:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb924f5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa1ab expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438264.308877:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb924f65 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438264.308892:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb924f65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438264.308906:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb924f65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438264.308921:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb924f6c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438264.308928:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb924f6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438264.308949:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb924f6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438264.309388:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db200/0x7a8dd0fcbb924f73 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438264.309398:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db200/0x7a8dd0fcbb924f73 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438264.309406:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db200/0x7a8dd0fcbb924f73 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438264.309432:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789438264.309435:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789438264.309455:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db200/0x7a8dd0fcbb924f73 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438264.309465:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb924f65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438264.309472:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb924f65 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438264.309478:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb924f65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438264.309485:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9db400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438264.309490:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb924f65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438264.309498:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb924f65 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438264.309605:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872a00) 00010000:00010000:1.0:1789438264.309609:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438264.309615:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb924f65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438264.309623:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb924f65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438264.309636:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb924f6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438264.309643:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb924f6c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438264.309649:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb924f6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438264.309655:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dac00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438264.309658:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb924f6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438264.309664:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb924f6c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438264.309671:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9991c7c83e00) 00010000:00010000:1.0:1789438264.309674:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438264.309677:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb924f6c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438264.309683:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb924f6c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438264.309765:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb924f5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1ab expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438264.309782:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db200/0x7a8dd0fcbb924f73 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1ab expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438264.309788:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9991c7c83100) 00010000:00010000:1.0:1789438264.309791:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789438264.309793:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9db200, rc 0) 00000100:00100000:1.0:1789438264.309871:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+7:10240:x1876361749750656:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 1109us (1968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438264.309879:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 33 00000100:00100000:1.0:1789438264.316296:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438264.316429:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749750912 00000100:00100000:2.0:1789438264.316440:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749750912 00000100:00100000:2.0:1789438264.316525:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 34 00000100:00100000:2.0:1789438264.316537:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+7:10240:x1876361749750912:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789438264.316559:0:7624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438264.316580:0:7624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb924f7a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa1b2 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.316654:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924f81 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.316669:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924f81 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.316680:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924f81 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.316782:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb924f88 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.316791:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb924f88 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.316798:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb924f88 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.317377:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0c00/0x7a8dd0fcbb924f8f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.317389:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0c00/0x7a8dd0fcbb924f8f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.317396:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0c00/0x7a8dd0fcbb924f8f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438264.317419:0:7624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789438264.319384:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924f81 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.319399:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924f81 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.319407:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924f81 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.319414:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438264.319418:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924f81 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.319425:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924f81 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.319441:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9991c7c83100) 00010000:00010000:2.0:1789438264.319445:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438264.319449:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924f81 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.319455:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb924f81 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.319469:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb924f88 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.319474:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb924f88 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.319495:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb924f88 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.319500:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f1400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438264.319503:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb924f88 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.319509:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb924f88 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.319517:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9991d5872700) 00010000:00010000:2.0:1789438264.319520:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438264.319523:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb924f88 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.319528:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb924f88 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.320112:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb924f7a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1b2 expref: 10 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.320142:0:7624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0c00/0x7a8dd0fcbb924f8f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1b2 expref: 9 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438264.320151:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9991d5872000) 00010000:00010000:2.0:1789438264.320153:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438264.320156:0:7624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f0c00, rc 0) 00000100:00100000:2.0:1789438264.320225:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+9:10240:x1876361749750912:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 3690us (3938us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789438264.320243:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 34 00000100:00100000:3.0:1789438264.350680:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438264.350876:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749751040 00000100:00100000:2.0:1789438264.350889:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749751040 00000100:00100000:2.0:1789438264.350955:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 35 00000100:00100000:2.0:1789438264.350968:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+9:10240:x1876361749751040:12345-192.168.206.9@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789438264.351112:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+9:10240:x1876361749751040:12345-192.168.206.9@tcp:59:lhsmtool_posix.0 Request processed in 146us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438264.351120:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 35 00000040:00080000:3.0:1789438264.829872:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789438265.207645:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438265.816908:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438265.817567:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438265.817611:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438265.819090:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749751168 00000100:00100000:2.0:1789438265.819104:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749751168 00000100:00100000:2.0:1789438265.819181:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 281 00000100:00100000:2.0:1789438265.819193:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+13:2354:x1876361749751168:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789438265.819273:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+13:2354:x1876361749751168:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 81us (1707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438265.819280:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 281 00000100:00100000:3.0:1789438265.832672:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749751296 00000100:00100000:3.0:1789438265.832688:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749751296 00000100:00100000:3.0:1789438265.832767:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749751424 00000100:00100000:3.0:1789438265.832771:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749751424 00000100:00100000:3.0:1789438265.832806:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 127 00000100:00100000:3.0:1789438265.832817:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+9:2354:x1876361749751296:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438265.832896:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+9:2354:x1876361749751296:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 81us (15998us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438265.832903:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 127 00000100:00100000:3.0:1789438265.832921:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 128 00000100:00100000:3.0:1789438265.832927:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa74b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2354:x1876361749751424:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438265.832952:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa74b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2354:x1876361749751424:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 25us (15341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438265.832958:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 128 00000100:00080000:3.0:1789438265.832975:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789438266.230863:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438266.334696:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438266.336828:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749751552 00000100:00100000:1.0:1789438266.336843:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749751552 00000100:00100000:1.0:1789438266.336911:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 36 00000100:00100000:1.0:1789438266.336923:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d05d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+9:10283:x1876361749751552:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438266.336943:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438266.336963:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb924f9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa1b9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789438266.337187:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789438266.337257:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb924fa4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.337272:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb924fa4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.337296:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb924fa4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.337313:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb924fab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.337320:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb924fab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.337327:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb924fab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.337589:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb924fa4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.337599:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb924fa4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.337606:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb924fa4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.337612:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9da600 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438266.337616:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb924fa4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.337624:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb924fa4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.337637:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872a00) 00010000:00010000:1.0:1789438266.337640:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438266.337645:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb924fa4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.337658:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb924fa4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.337670:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb924fab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.337676:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb924fab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.337682:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb924fab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.337686:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9da200 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438266.337689:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb924fab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.337695:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb924fab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.337703:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9991c7c83500) 00010000:00010000:1.0:1789438266.338194:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438266.338199:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb924fab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.338206:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb924fab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.338248:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb924f9d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1b9 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.338270:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872a00) 00010000:00010000:1.0:1789438266.338273:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438266.338277:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb924f9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1b9 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.338287:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9da000, rc 0) 00000100:00100000:1.0:1789438266.338447:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d05d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+9:10283:x1876361749751552:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 1516us (3750us total) trans 0 rc 301/301 00000100:00100000:1.0:1789438266.338455:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 36 00000100:00100000:0.0:1789438266.354207:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438266.359573:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749751808 00000100:00100000:1.0:1789438266.359592:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749751808 00000100:00100000:1.0:1789438266.359651:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 37 00000100:00100000:1.0:1789438266.359661:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+9:10283:x1876361749751808:12345-192.168.206.9@tcp:36:lfs.0 00010000:00010000:1.0:1789438266.360785:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438266.360821:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924f57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1a4 expref: 9 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.360836:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872a00) 00010000:00010000:1.0:1789438266.360846:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789438266.361061:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb924fb2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.361074:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb924fb2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.361085:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb924fb2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.361307:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb924fb9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.361319:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb924fb9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.361326:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb924fb9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438266.362439:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789438266.362452:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb924fb2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.362462:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb924fb2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.362470:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb924fb2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.362476:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9da000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438266.362481:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb924fb2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.362490:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb924fb2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.362502:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991c7c83500) 00010000:00010000:1.0:1789438266.362505:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438266.362509:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb924fb2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.363695:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb924fb2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789438266.363750:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004816d256 reply state 0000000040c14b84 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb924fb9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438266.363760:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789438266.363879:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+10:10283:x1876361749751808:12345-192.168.206.9@tcp:36:lfs.0 Request processed in 4216us (9677us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789438266.363887:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 37 00010000:00010000:3.0:1789438266.366518:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb924fb9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.366542:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb924fb9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.366550:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb924fb9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.366556:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9da200 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438266.366560:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb924fb9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.366568:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb924fb9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.366584:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9991c7c83800) 00010000:00010000:3.0:1789438266.366587:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789438266.366592:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb924fb9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.366598:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb924fb9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438266.495221:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438266.495268:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749751936 00000100:00100000:0.0:1789438266.495278:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749751936 00000100:00100000:0.0:1789438266.495332:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 38 00000100:00100000:0.0:1789438266.495342:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+9:10291:x1876361749751936:12345-192.168.206.9@tcp:101:lctl.0 00010000:00010000:0.0:1789438266.495376:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438266.495399:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb924fc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa1c0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438266.495476:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb924fc7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438266.495490:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb924fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438266.495503:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb924fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438266.495550:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789438266.495554:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789438266.495595:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb924fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438266.495620:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb924fc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1c0 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438266.495639:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb924fc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1c0 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438266.495648:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991c3ac2e00) 00010000:00010000:0.0:1789438266.495651:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789438266.495654:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63600, rc 0) 00000100:00100000:0.0:1789438266.495724:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+10:10291:x1876361749751936:12345-192.168.206.9@tcp:101:lctl.0 Request processed in 364us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438266.495733:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 38 00000100:00100000:3.0:1789438266.554274:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438266.555217:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749752064 00000100:00100000:0.0:1789438266.555228:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749752064 00000100:00100000:2.0:1789438266.555498:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 39 00000100:00100000:2.0:1789438266.555510:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+10:10297:x1876361749752064:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:2.0:1789438266.555530:0:7624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438266.555553:0:7624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924fce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa1c7 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.555617:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb924fd5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.555650:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb924fd5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.555663:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb924fd5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.555679:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb924fdc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.555686:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb924fdc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.555692:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb924fdc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.555820:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1a00/0x7a8dd0fcbb924fe3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.555833:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1a00/0x7a8dd0fcbb924fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.555841:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1a00/0x7a8dd0fcbb924fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438266.555870:0:7624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789438266.555873:0:7624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789438266.555914:0:7624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1a00/0x7a8dd0fcbb924fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.555925:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb924fd5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.555942:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb924fd5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.555948:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb924fd5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.555955:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f1000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438266.555960:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb924fd5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.555968:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb924fd5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.555980:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991c3ac2e00) 00010000:00010000:2.0:1789438266.555984:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438266.555988:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb924fd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.555994:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb924fd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.556009:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb924fdc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.556014:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb924fdc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.556020:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb924fdc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.556025:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f1600 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438266.556172:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb924fdc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.556180:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb924fdc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.556189:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9991d5872b00) 00010000:00010000:2.0:1789438266.556191:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438266.556194:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb924fdc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.556200:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb924fdc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.556233:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb924fce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1c7 expref: 12 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.556321:0:7624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1a00/0x7a8dd0fcbb924fe3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1c7 expref: 11 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.556329:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:2.0:1789438266.556331:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789438266.556333:0:7624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f1a00, rc 0) 00000100:00100000:2.0:1789438266.556456:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+11:10297:x1876361749752064:12345-192.168.206.9@tcp:101:bash.0 Request processed in 947us (2189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438266.556464:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 39 00000100:00100000:0.0:1789438266.560998:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438266.561177:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749752320 00000100:00100000:3.0:1789438266.561189:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749752320 00000100:00100000:3.0:1789438266.561289:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 40 00000100:00100000:3.0:1789438266.561300:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+11:10297:x1876361749752320:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:3.0:1789438266.561323:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438266.561356:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb924fea lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa1ce expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.561508:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb924ff1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.561523:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb924ff1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.561535:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb924ff1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.561597:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924ff8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.561605:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924ff8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.561612:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924ff8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789438266.562642:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1789438266.562930:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54600/0x7a8dd0fcbb924fff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.562944:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54600/0x7a8dd0fcbb924fff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.562953:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54600/0x7a8dd0fcbb924fff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.563203:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb924ff1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.563222:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb924ff1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.563229:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb924ff1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.563235:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55e00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438266.563239:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb924ff1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.563247:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb924ff1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.563258:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:3.0:1789438266.563261:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789438266.563266:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb924ff1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.563272:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb924ff1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789438266.563286:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3563b1e reply state 00000000c215be94 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924ff8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438266.563295:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789438266.563325:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb924fea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1ce expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.563339:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54600/0x7a8dd0fcbb924fff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1ce expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.563356:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d192c300) 00010000:00010000:3.0:1789438266.563358:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789438266.563360:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a54600, rc 0) 00000100:00100000:3.0:1789438266.563470:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+14:10297:x1876361749752320:12345-192.168.206.9@tcp:101:bash.0 Request processed in 2171us (2482us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789438266.563479:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 40 00000100:00100000:2.0:1789438266.567195:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00010000:00010000:3.0:1789438266.567333:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924ff8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.567347:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924ff8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.567355:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924ff8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.567360:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54c00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438266.567366:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924ff8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.567374:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924ff8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.567391:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9991d192cd00) 00010000:00010000:3.0:1789438266.567394:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789438266.567399:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924ff8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.567405:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb924ff8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438266.567495:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749752448 00000100:00100000:0.0:1789438266.567507:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749752448 00000100:00100000:0.0:1789438266.567580:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 20 00000100:00100000:0.0:1789438266.567590:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d05d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1876361749752448:12345-192.168.206.9@tcp:8:bash.0 00010000:00080000:0.0:1789438266.567623:0:6682:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 1274be99-2d57-4dac-a13e-a89426512ee0@192.168.206.9@tcp t0 exp 0000000000000000 cur 318 last 0 00000020:00000080:0.0:1789438266.567653:0:6682:0:(genops.c:1384:class_connect()) connect: client 1274be99-2d57-4dac-a13e-a89426512ee0, cookie 0x7a8dd0fcbb92500d 00002000:00100000:0.0:1789438266.567665:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1274be99-2d57-4dac-a13e-a89426512ee0/ffff9991c7de5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789438266.567687:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:0.0:1789438266.567967:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789438266.567998:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9991c7de4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789438266.568082:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d05d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+6:2352:x1876361749752448:12345-192.168.206.9@tcp:8:bash.0 Request processed in 492us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438266.568090:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 20 00000100:00100000:2.0:1789438266.572085:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438266.572272:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749752576 00000100:00100000:0.0:1789438266.572283:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749752576 00000100:00080000:3.0:1789438266.572340:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789438266.572383:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 21 00000100:00100000:0.0:1789438266.572394:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d05d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1274be99-2d57-4dac-a13e-a89426512ee0+6:0:x1876361749752576:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:0.0:1789438266.572412:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438266.572437:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc8e1a3/0x7a8dd0fcbb925014 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa1d5 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789438266.572463:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789438266.572481:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=318s v=(0 0) 00010000:00010000:0.0:1789438266.572497:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789438266.572507:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc8e1a3/0x7a8dd0fcbb925014 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1d5 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438266.572527:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc8e1a3/0x7a8dd0fcbb925014 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1d5 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438266.572540:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63200, rc 0) 00000100:00100000:0.0:1789438266.572690:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d05d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1274be99-2d57-4dac-a13e-a89426512ee0+7:0:x1876361749752576:12345-192.168.206.9@tcp:101:bash.0 Request processed in 297us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438266.572697:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 21 00000100:00100000:3.0:1789438266.577271:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438266.577777:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749752704 00000100:00100000:2.0:1789438266.577789:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749752704 00000100:00100000:2.0:1789438266.577996:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 22 00000100:00100000:2.0:1789438266.578007:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+7:10297:x1876361749752704:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:2.0:1789438266.578026:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438266.578150:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044746fdd/0x7a8dd0fcbb92501b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa1dc expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.578183:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc8e1a3/0x7a8dd0fcbb925014 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1d5 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.578192:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789438266.578197:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789438266.578202:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044746fdd/0x7a8dd0fcbb92501b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1dc expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.578306:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000cc8e1a3/0x7a8dd0fcbb925014 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1d5 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.578321:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000cc8e1a3/0x7a8dd0fcbb925014 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1d5 expref: 8 pid: 6681 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438266.578337:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d05d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876361769710720:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789438266.578553:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d019cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789438266.581688:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d05d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876361769710720:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438266.581772:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000044746fdd/0x7a8dd0fcbb92501b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1dc expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438266.581793:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f1600, rc 0) 00000100:00100000:0.0:1789438266.581858:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+8:10297:x1876361749752704:12345-192.168.206.9@tcp:101:bash.0 Request processed in 3852us (4598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438266.581867:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 22 00000100:00100000:2.0:1789438266.583469:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438266.583611:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749752832 00000100:00100000:0.0:1789438266.583621:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749752832 00010000:00010000:0.0:1789438266.583662:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000cc8e1a3/0x7a8dd0fcbb925014 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1d5 expref: 8 pid: 6681 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438266.583760:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 35 00000100:00100000:0.0:1789438266.583770:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d05d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+8:2353:x1876361749752832:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789438266.583798:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438266.583822:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000cc8e1a3/0x7a8dd0fcbb925014 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1d5 expref: 8 pid: 6681 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438266.583835:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000cc8e1a3/0x7a8dd0fcbb925014 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1d5 expref: 8 pid: 6681 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438266.583857:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc8e1a3/0x7a8dd0fcbb925014 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1d5 expref: 8 pid: 6681 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438266.583874:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789438266.583878:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789438266.583886:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000044746fdd/0x7a8dd0fcbb92501b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1dc expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438266.583896:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044746fdd/0x7a8dd0fcbb92501b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1dc expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438266.583940:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000044746fdd/0x7a8dd0fcbb92501b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1dc expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438266.583955:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3122a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5822:1876361769710848:192.168.206.9@tcp:105: 00000100:00100000:0.0:1789438266.584031:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f44a7780 going to sleep for 11 seconds 00000100:00100000:0.0:1789438266.585979:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3122a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5822:1876361769710848:192.168.206.9@tcp:105: 00010000:00010000:0.0:1789438266.586017:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438266.586090:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d05d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+7:2353:x1876361749752832:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 2321us (2625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438266.586101:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 35 00000100:00100000:2.0:1789438266.587345:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438266.587419:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749753088 00000100:00100000:1.0:1789438266.587428:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749753088 00000100:00100000:1.0:1789438266.587482:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 6 00000100:00100000:1.0:1789438266.587491:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d05d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+13:10297:x1876361749753088:12345-192.168.206.9@tcp:35:bash.0 00000100:00100000:1.0:1789438266.588201:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d05d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+14:10297:x1876361749753088:12345-192.168.206.9@tcp:35:bash.0 Request processed in 708us (858us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789438266.588210:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 6 00000100:00100000:2.0:1789438266.647883:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438266.647977:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749753344 00000100:00100000:1.0:1789438266.647987:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749753344 00000100:00100000:1.0:1789438266.648059:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 41 00000100:00100000:1.0:1789438266.648071:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d05d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+14:10307:x1876361749753344:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438266.648096:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438266.648130:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb925022 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa1e3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438266.648215:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789438266.648343:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb925022 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1e3 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.648368:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991c3ac2e00) 00010000:00010000:1.0:1789438266.648372:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789438266.648378:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb925022 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1e3 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.648392:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9da000, rc 0) 00000100:00100000:1.0:1789438266.648775:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d05d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+15:10307:x1876361749753344:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 705us (901us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1789438266.648783:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 41 00000100:00100000:3.0:1789438266.652241:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438266.652358:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749753600 00000100:00100000:0.0:1789438266.652437:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749753600 00000100:00100000:0.0:1789438266.652734:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:0.0:1789438266.652746:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+15:10307:x1876361749753600:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:0.0:1789438266.652982:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+16:10307:x1876361749753600:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 237us (749us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789438266.652990:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:0.0:1789438266.727871:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438266.728159:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749753728 00000100:00100000:1.0:1789438266.728170:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749753728 00000100:00100000:1.0:1789438266.728232:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 42 00000100:00100000:1.0:1789438266.728387:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+16:10313:x1876361749753728:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438266.728411:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438266.728432:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb925030 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa1ea expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.728496:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925037 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.728511:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.728523:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438266.728658:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789438266.728662:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789438266.728679:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.728703:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb925030 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1ea expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.728756:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925037 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1ea expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.728764:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:1.0:1789438266.728767:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789438266.728771:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9da600, rc 0) 00000100:00100000:1.0:1789438266.728915:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+17:10313:x1876361749753728:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 673us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438266.728923:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 42 00000100:00100000:2.0:1789438266.740805:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438266.740942:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749753984 00000100:00100000:1.0:1789438266.740953:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749753984 00000100:00100000:1.0:1789438266.741108:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 43 00000100:00100000:1.0:1789438266.741135:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d05d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+17:10313:x1876361749753984:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438266.741157:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438266.741179:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb92503e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa1f1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.741703:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925045 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.741778:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.741793:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438266.741806:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789438266.742020:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb92503e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1f1 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.742127:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925045 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1f1 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.742138:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d192c300) 00010000:00010000:1.0:1789438266.742140:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789438266.742144:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9dba00, rc 0) 00000100:00100000:0.0:1789438266.742338:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d05d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+19:10313:x1876361749753984:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 1205us (1540us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789438266.742347:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 43 00000100:00100000:2.0:1789438266.745494:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438266.745619:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749754240 00000100:00100000:3.0:1789438266.745630:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749754240 00000100:00100000:3.0:1789438266.745688:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 44 00000100:00100000:3.0:1789438266.745698:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d05d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+19:10313:x1876361749754240:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:3.0:1789438266.745755:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438266.745776:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb925053 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa1f8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.745874:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92505a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.745888:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92505a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.745900:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92505a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789438266.745912:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789438266.746037:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb925053 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1f8 expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.746064:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92505a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1f8 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.746072:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d192c300) 00010000:00010000:3.0:1789438266.746086:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789438266.746090:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a54800, rc 0) 00000100:00100000:3.0:1789438266.746155:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d05d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+21:10313:x1876361749754240:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 458us (669us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789438266.746163:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 44 00000100:00100000:2.0:1789438266.747919:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438266.748555:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749754368 00000100:00100000:1.0:1789438266.748575:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749754368 00000100:00100000:1.0:1789438266.748629:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 2 00000100:00100000:1.0:1789438266.748639:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+21:2356:x1876361749754368:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789438266.748653:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438266.748675:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925045 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1f1 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.748692:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d192c300) 00010000:00010000:1.0:1789438266.748697:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438266.748771:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+20:2356:x1876361749754368:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 133us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438266.748790:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 2 00000100:00100000:0.0:1789438266.761748:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438266.761805:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749754496 00000100:00100000:3.0:1789438266.761816:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749754496 00000100:00100000:3.0:1789438266.761874:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 23 00000100:00100000:3.0:1789438266.761885:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1274be99-2d57-4dac-a13e-a89426512ee0+7:2354:x1876361749754496:12345-192.168.206.9@tcp:1:lfs.0 00010000:00010000:3.0:1789438266.761933:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d092743b/0x7a8dd0fcbb925068 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.761954:0:8192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000044746fdd/0x7a8dd0fcbb92501b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1dc expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.761963:0:8192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789438266.761967:0:8192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789438266.761971:0:8192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d092743b/0x7a8dd0fcbb925068 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.762007:0:8192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000044746fdd/0x7a8dd0fcbb92501b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1dc expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.762021:0:8192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000044746fdd/0x7a8dd0fcbb92501b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1dc expref: 7 pid: 6680 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438266.762043:0:8192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff953800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8192:1876361769710976:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789438266.762168:0:8192:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fabaaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789438266.767162:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438266.767279:0:8192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff953800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8192:1876361769710976:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789438266.767308:0:8192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d092743b/0x7a8dd0fcbb925068 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438266.767657:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749754624 00000100:00100000:0.0:1789438266.767667:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749754624 00002000:00100000:0.0:1789438266.768251:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9991d06b3100 x1876361749754624/t0(0) o4->1274be99-2d57-4dac-a13e-a89426512ee0@192.168.206.9@tcp:697/0 lens 504/0 e 0 to 0 dl 1789438277 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789438266.768263:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9991d06b3100 with x1876361749754624 ext(0->12) 00010000:00010000:0.0:1789438266.768273:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000044746fdd/0x7a8dd0fcbb92501b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1dc expref: 8 pid: 6680 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438266.768290:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000044746fdd/0x7a8dd0fcbb92501b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1dc expref: 8 pid: 6680 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789438266.768298:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9991d06b3100 00000100:00100000:0.0:1789438266.768395:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00100000:0.0:1789438266.768407:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1274be99-2d57-4dac-a13e-a89426512ee0+8:2353:x1876361749754624:12345-192.168.206.9@tcp:4:lfs.0 00000001:00100000:1.0:1789438266.835917:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1274be99-2d57-4dac-a13e-a89426512ee0 00000001:00080000:2.0:1789438266.871182:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1789438266.871866:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1274be99-2d57-4dac-a13e-a89426512ee0+7:2353:x1876361749754624:12345-192.168.206.9@tcp:4:lfs.0 Request processed in 103455us (104706us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789438266.871880:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 0 00002000:00100000:0.0:1789438266.871893:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9991d06b3100 x1876361749754624/t4294967299(0) o4->1274be99-2d57-4dac-a13e-a89426512ee0@192.168.206.9@tcp:697/0 lens 504/448 e 0 to 0 dl 1789438277 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789438266.871904:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9991d06b3100 with x1876361749754624 ext(0->12) 00010000:00010000:0.0:1789438266.871915:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000044746fdd/0x7a8dd0fcbb92501b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1dc expref: 7 pid: 6680 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438266.871935:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000044746fdd/0x7a8dd0fcbb92501b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1dc expref: 7 pid: 6680 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789438266.871944:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9991d06b3100 00000100:00100000:2.0:1789438266.880686:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438266.881099:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749754752 00000100:00100000:0.0:1789438266.881110:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749754752 00010000:00010000:2.0:1789438266.881239:0:8438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000044746fdd/0x7a8dd0fcbb92501b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1dc expref: 7 pid: 6680 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438266.885490:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 36 00000100:00100000:2.0:1789438266.885517:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1274be99-2d57-4dac-a13e-a89426512ee0+7:2354:x1876361749754752:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789438266.885540:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789438266.885814:0:8438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789438266.885818:0:8438:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789438266 00002000:00010000:2.0:1789438266.885821:0:8438:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789438266 00002000:00010000:2.0:1789438266.885823:0:8438:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789438266 00002000:00010000:2.0:1789438266.885825:0:8438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1789438266.885834:0:8438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000044746fdd/0x7a8dd0fcbb92501b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1dc expref: 7 pid: 6680 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.885853:0:8438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000044746fdd/0x7a8dd0fcbb92501b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1dc expref: 7 pid: 6680 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.885883:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044746fdd/0x7a8dd0fcbb92501b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1dc expref: 7 pid: 6680 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.885901:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789438266.885906:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789438266.885926:0:8438:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d092743b/0x7a8dd0fcbb925068 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.885936:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d092743b/0x7a8dd0fcbb925068 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.885974:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789438266.886165:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1274be99-2d57-4dac-a13e-a89426512ee0+6:2354:x1876361749754752:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 659us (5485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438266.886173:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 36 00010000:00010000:3.0:1789438266.886243:0:8192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d092743b/0x7a8dd0fcbb925068 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.886254:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d092743b/0x7a8dd0fcbb925068 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.886279:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d092743b/0x7a8dd0fcbb925068 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.886287:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d092743b/0x7a8dd0fcbb925068 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.886294:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d092743b/0x7a8dd0fcbb925068 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.886301:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55e00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:3.0:1789438266.886305:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d092743b/0x7a8dd0fcbb925068 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.886314:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d092743b/0x7a8dd0fcbb925068 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.886340:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d092743b/0x7a8dd0fcbb925068 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.886348:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d092743b/0x7a8dd0fcbb925068 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438266.886397:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1274be99-2d57-4dac-a13e-a89426512ee0+5:2354:x1876361749754496:12345-192.168.206.9@tcp:1:lfs.0 Request processed in 124515us (124660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438266.886406:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 23 00000100:00100000:1.0:1789438266.891284:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438266.891460:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749755008 00000100:00100000:2.0:1789438266.891473:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749755008 00000100:00100000:2.0:1789438266.891547:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 8 00000100:00100000:2.0:1789438266.891559:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+20:10313:x1876361749755008:12345-192.168.206.9@tcp:35:lfs.0 00000004:00010000:2.0:1789438266.891625:0:5841:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92505a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1f8 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789438266.892168:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1789438266.892229:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1789438266.892797:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1789438266.892870:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb92506f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.892887:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54600/0x7a8dd0fcbb924fff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1ce expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.892897:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb92506f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.892934:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54600/0x7a8dd0fcbb924fff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1ce expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.892949:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54600/0x7a8dd0fcbb924fff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1ce expref: 24 pid: 5840 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438266.892977:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff953800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5841:1876361769711104:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789438266.893083:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fabaacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789438266.898974:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff953800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5841:1876361769711104:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438266.899006:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb92506f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438266.900179:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438266.900424:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749755136 00000100:00100000:1.0:1789438266.900433:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749755136 00010000:00010000:1.0:1789438266.900537:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54600/0x7a8dd0fcbb924fff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1ce expref: 25 pid: 5840 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438266.900583:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 37 00000100:00100000:1.0:1789438266.900593:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff953800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+25:2353:x1876361749755136:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789438266.900607:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438266.900613:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54600/0x7a8dd0fcbb924fff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1ce expref: 25 pid: 5840 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.900627:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54600/0x7a8dd0fcbb924fff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1ce expref: 25 pid: 5840 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.900650:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54600/0x7a8dd0fcbb924fff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1ce expref: 25 pid: 5840 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.900667:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d192c300) 00010000:00010000:1.0:1789438266.901051:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb92506f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.901063:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb92506f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.901089:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb92506f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438266.901130:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438266.901196:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff953800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+24:2353:x1876361749755136:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 604us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438266.901204:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 37 00010000:00010000:0.0:1789438266.901283:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb92506f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438266.901291:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb92506f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789438266.901421:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1789438266.901635:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1789438266.901810:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7db7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1876361769711232:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789438266.901892:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438266.901926:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f44a7540 going to sleep for 11 seconds 00000100:00100000:1.0:1789438266.903864:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769711232 00000100:00100000:1.0:1789438266.903880:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769711232 00000100:00100000:1.0:1789438266.903958:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789438266.903970:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1876361769711232:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789438266.904086:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1876361769711232:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 119us (2194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438266.904094:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789438266.904159:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789438266.904202:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7db7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1876361769711232:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789438266.904890:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1789438266.904966:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7db7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1876361769711360:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789438266.905010:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438266.905038:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f44a7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789438266.905690:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769711360 00000100:00100000:1.0:1789438266.905699:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769711360 00000100:00100000:1.0:1789438266.905763:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789438266.905771:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1876361769711360:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789438266.906025:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1876361769711360:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 254us (1014us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789438266.906032:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789438266.906536:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7db7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1876361769711360:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789438266.906603:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1789438266.906650:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb92506f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.906662:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb92506f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.906669:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb92506f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.906675:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55e00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438266.906680:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb92506f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.906687:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb92506f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.906702:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d192c300) 00010000:00010000:3.0:1789438266.906735:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789438266.906740:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb92506f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438266.906747:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb92506f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789438266.906930:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789438266.907185:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1789438266.907196:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 319172487578ns, next at 320172485984ns, rc = 0 00000001:00080000:3.0:1789438266.907202:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1789438266.907234:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d192c300) 00010000:00010000:3.0:1789438266.907249:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789438266.907257:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92505a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1f8 expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438266.907363:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+27:10313:x1876361749755008:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 15806us (16088us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1789438266.907372:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 8 00000020:00080000:3.0:1789438266.907376:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789438266.918180:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438266.918385:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749755264 00000100:00100000:2.0:1789438266.918396:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749755264 00000100:00100000:2.0:1789438266.918482:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 45 00000100:00100000:2.0:1789438266.918493:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+27:10313:x1876361749755264:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789438266.918520:0:7624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438266.918543:0:7624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb925076 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa1ff expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.918605:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb925076 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1ff expref: 28 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.918641:0:7624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb925076 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1ff expref: 28 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.918662:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:2.0:1789438266.918666:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789438266.918670:0:7624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f1600, rc 0) 00000100:00100000:2.0:1789438266.918761:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+28:10313:x1876361749755264:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 269us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438266.918769:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 45 00000100:00100000:1.0:1789438266.922471:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438266.922578:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749755520 00000100:00100000:0.0:1789438266.922591:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749755520 00000100:00100000:0.0:1789438266.922651:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:0.0:1789438266.922662:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d21bf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+28:10313:x1876361749755520:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:0.0:1789438266.922921:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d21bf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+29:10313:x1876361749755520:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 260us (461us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1789438266.922929:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:3.0:1789438266.991225:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438266.991657:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749755776 00000100:00100000:0.0:1789438266.991669:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749755776 00000100:00100000:0.0:1789438266.991771:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 46 00000100:00100000:0.0:1789438266.991784:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+29:10323:x1876361749755776:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:0.0:1789438266.991811:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438266.991833:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb92507d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa206 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438266.991954:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789438266.992085:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb92507d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa206 expref: 31 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438266.992100:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991c3ac2e00) 00010000:00010000:0.0:1789438266.992103:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789438266.992109:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb92507d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa206 expref: 31 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438266.992135:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d62600, rc 0) 00000100:00100000:0.0:1789438266.992193:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+30:10323:x1876361749755776:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 413us (977us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1789438266.992200:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 46 00000100:00100000:1.0:1789438266.995947:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438266.996144:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749755904 00000100:00100000:2.0:1789438266.996154:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749755904 00000100:00100000:2.0:1789438266.996214:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 47 00000100:00100000:2.0:1789438266.996226:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+30:10323:x1876361749755904:12345-192.168.206.9@tcp:34:lfs.0 00010000:00010000:2.0:1789438266.996313:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92508b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.996331:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92508b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.996343:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92508b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.996361:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925092 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.996368:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.996395:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.996482:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925099 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.996491:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.996498:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789438266.996546:0:7624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.996560:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92508b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.996567:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92508b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.996574:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92508b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.996580:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438266.996584:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92508b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.996591:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92508b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.996604:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:2.0:1789438266.996614:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438266.996619:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92508b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.996626:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92508b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.996641:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.996647:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925092 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.996653:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925092 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.996657:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f1800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438266.996660:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925092 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.996666:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925092 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.996674:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9991d5872b00) 00010000:00010000:2.0:1789438266.996676:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438266.996679:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925092 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.996685:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925092 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.996700:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.996762:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925099 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.996768:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925099 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.996772:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f1400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438266.996775:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925099 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.996781:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925099 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.996789:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:2.0:1789438266.996792:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438266.996794:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925099 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438266.996799:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925099 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438266.996882:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+30:10323:x1876361749755904:12345-192.168.206.9@tcp:34:lfs.0 Request processed in 656us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438266.996890:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 47 00000100:00100000:2.0:1789438267.002646:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438267.002756:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749756160 00000100:00100000:0.0:1789438267.002765:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749756160 00000100:00100000:0.0:1789438267.002815:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:0.0:1789438267.002824:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+30:10323:x1876361749756160:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:0.0:1789438267.003227:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+31:10323:x1876361749756160:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 223us (408us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1789438267.003235:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:3.0:1789438267.049684:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438267.049820:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749756416 00000100:00100000:0.0:1789438267.049831:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749756416 00000100:00100000:0.0:1789438267.049892:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 48 00000100:00100000:0.0:1789438267.049902:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+31:10326:x1876361749756416:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:0.0:1789438267.049928:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438267.049961:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9250a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa20d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.050036:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9250a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.050064:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9250a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.050076:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9250a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.050093:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9250ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.050101:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9250ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.050107:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9250ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.050414:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb9250b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.050425:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb9250b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.050432:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb9250b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438267.050443:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789438267.050538:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9250a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.050557:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9250a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.050563:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9250a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.050569:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438267.050573:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9250a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.050582:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9250a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.050594:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:0.0:1789438267.050596:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438267.050601:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9250a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.050607:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9250a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.050621:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9250ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.050626:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9250ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.050633:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9250ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.050637:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d62c00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438267.050647:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9250ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.050652:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9250ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.050660:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9991c3ac2600) 00010000:00010000:0.0:1789438267.050663:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438267.050665:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9250ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.050671:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9250ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.050870:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9250a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa20d expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.050887:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb9250b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa20d expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.050895:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:0.0:1789438267.050897:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789438267.050900:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d62000, rc 0) 00000100:00100000:1.0:1789438267.051023:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+33:10326:x1876361749756416:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 1120us (1348us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1789438267.051032:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 48 00000100:00100000:1.0:1789438267.054980:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438267.055075:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749756544 00000100:00100000:2.0:1789438267.055085:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749756544 00000100:00100000:2.0:1789438267.055149:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 49 00000100:00100000:2.0:1789438267.055159:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+33:10326:x1876361749756544:12345-192.168.206.9@tcp:54:lfs.0 00010000:00010000:2.0:1789438267.055246:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb9250c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.055263:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb9250c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.055273:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb9250c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.055299:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb9250c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.055306:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb9250c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.055312:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb9250c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.055318:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f1800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438267.055323:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb9250c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.055330:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb9250c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.055340:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:2.0:1789438267.055343:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789438267.055348:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb9250c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.055353:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb9250c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438267.055431:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+33:10326:x1876361749756544:12345-192.168.206.9@tcp:54:lfs.0 Request processed in 273us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438267.055438:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 49 00000100:00100000:2.0:1789438267.058034:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438267.058179:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749756800 00000100:00100000:3.0:1789438267.058191:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749756800 00000100:00100000:3.0:1789438267.058262:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 11 00000100:00100000:3.0:1789438267.058273:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+33:10326:x1876361749756800:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:3.0:1789438267.058540:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+34:10326:x1876361749756800:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 267us (513us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1789438267.058548:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 11 00010000:00010000:1.0:1789438267.254941:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438267.276173:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438267.276418:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749757056 00000100:00100000:1.0:1789438267.276429:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749757056 00000100:00100000:1.0:1789438267.276492:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 50 00000100:00100000:1.0:1789438267.276503:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+34:10357:x1876361749757056:12345-192.168.206.9@tcp:101:cat.0 00010000:00010000:1.0:1789438267.276529:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438267.276553:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb9250ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa214 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438267.276649:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb9250d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438267.276663:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb9250d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438267.276676:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb9250d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438267.276688:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789438267.276911:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb9250ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa214 expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438267.276929:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb9250d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa214 expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438267.276937:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:1.0:1789438267.276940:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789438267.276944:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9dac00, rc 0) 00000100:00100000:1.0:1789438267.277003:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+36:10357:x1876361749757056:12345-192.168.206.9@tcp:101:cat.0 Request processed in 502us (840us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1789438267.277016:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 50 00000100:00100000:1.0:1789438267.283917:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438267.283967:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438267.284041:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749757312 00000100:00100000:3.0:1789438267.284059:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749757312 00000100:00100000:3.0:1789438267.284136:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 12 00000100:00100000:3.0:1789438267.284146:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+36:10357:x1876361749757312:12345-192.168.206.9@tcp:35:cat.0 00000100:00100000:3.0:1789438267.284402:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+37:10357:x1876361749757312:12345-192.168.206.9@tcp:35:cat.0 Request processed in 257us (493us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1789438267.284410:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 12 00000100:00100000:0.0:1789438267.284770:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749757440 00000100:00100000:0.0:1789438267.284775:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749757440 00000100:00100000:0.0:1789438267.284812:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 3 00000100:00100000:0.0:1789438267.284820:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d0513450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+37:2354:x1876361749757440:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789438267.284860:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438267.284883:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb9250d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa214 expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.284906:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:0.0:1789438267.284912:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438267.284945:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d0513450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+36:2354:x1876361749757440:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 126us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438267.284952:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 3 00000100:00100000:1.0:1789438267.371362:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438267.371562:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749757696 00000100:00100000:2.0:1789438267.371573:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749757696 00000100:00100000:2.0:1789438267.371636:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 51 00000100:00100000:2.0:1789438267.371647:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+36:10363:x1876361749757696:12345-192.168.206.9@tcp:101:dd.0 00010000:00010000:2.0:1789438267.371671:0:7624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438267.371675:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789438267.371701:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925037 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1ea expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.371756:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:2.0:1789438267.371761:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789438267.371774:0:7624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb9250df lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa21b expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.371880:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9250e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.371894:0:7624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb9250b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa20d expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.371902:0:7624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9250e6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.371936:0:7624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb9250b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa20d expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.371963:0:7624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb9250b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa20d expref: 36 pid: 5840 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438267.371978:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7624:1876361769711488:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789438267.372245:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c6d5d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789438267.378852:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438267.378954:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7624:1876361769711488:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789438267.378980:0:7624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9250e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438267.379208:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749757824 00000100:00100000:0.0:1789438267.379216:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749757824 00010000:00010000:0.0:1789438267.379266:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb9250b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa20d expref: 37 pid: 5840 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438267.379457:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 38 00000100:00100000:0.0:1789438267.379469:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+37:2353:x1876361749757824:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789438267.379484:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438267.379492:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb9250b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa20d expref: 37 pid: 5840 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.379504:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb9250b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa20d expref: 37 pid: 5840 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.379525:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb9250b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa20d expref: 37 pid: 5840 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.379541:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:0.0:1789438267.379545:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9250e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.379570:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9250e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.379579:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9250e6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.379609:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438267.379667:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+36:2353:x1876361749757824:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 200us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438267.379675:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 38 00010000:00010000:2.0:1789438267.379743:0:7624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9250e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.379750:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9250e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438267.379768:0:7624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789438267.379941:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb9250df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa21b expref: 37 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.379957:0:7624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9250e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa21b expref: 36 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.379965:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:2.0:1789438267.379967:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789438267.379969:0:7624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f1000, rc 0) 00000100:00100000:2.0:1789438267.379996:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+36:10363:x1876361749757696:12345-192.168.206.9@tcp:101:dd.0 Request processed in 8352us (8643us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1789438267.380013:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 51 00000100:00100000:3.0:1789438267.387833:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438267.388066:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749758080 00000100:00100000:1.0:1789438267.388077:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749758080 00000100:00100000:1.0:1789438267.388146:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 52 00000100:00100000:1.0:1789438267.388156:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+36:10363:x1876361749758080:12345-192.168.206.9@tcp:36:dd.0 00010000:00010000:1.0:1789438267.388450:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb9250f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438267.388467:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb9250f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438267.388480:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb9250f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789438267.388532:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1789438267.388557:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a3732cb reply state 0000000086025b6e transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb9250f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438267.388566:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789438267.388671:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+39:10363:x1876361749758080:12345-192.168.206.9@tcp:36:dd.0 Request processed in 515us (847us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1789438267.388678:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 52 00000020:00080000:1.0:1789438267.388683:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789438267.390956:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb9250f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.390974:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb9250f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.390981:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb9250f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.390988:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dae00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438267.390993:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb9250f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.391001:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb9250f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.391017:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:2.0:1789438267.391020:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438267.391025:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb9250f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.391032:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb9250f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438267.659457:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438267.659926:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749758208 00000100:00100000:0.0:1789438267.659937:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749758208 00000100:00100000:0.0:1789438267.660025:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 53 00000100:00100000:0.0:1789438267.660036:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+38:10377:x1876361749758208:12345-192.168.206.9@tcp:101:stat.0 00010000:00010000:0.0:1789438267.660379:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438267.660468:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb9250fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa222 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.660536:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb925102 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.660550:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb925102 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.660561:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb925102 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.660576:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925109 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.660600:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.660609:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.660698:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925110 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.660740:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9250e6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa21b expref: 39 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.660749:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925110 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.660788:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9250e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa21b expref: 39 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.660801:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9250e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa21b expref: 39 pid: 7624 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438267.660815:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7db5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876361769711616:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789438267.661134:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f44a7300 going to sleep for 11 seconds 00000100:00100000:0.0:1789438267.665654:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7db5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876361769711616:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438267.665690:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925110 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438267.666186:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438267.667250:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749758464 00000100:00100000:0.0:1789438267.667506:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749758464 00000100:00100000:0.0:1789438267.667580:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:0.0:1789438267.667590:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+40:5593:x1876361749758464:12345-192.168.206.9@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789438267.667971:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+41:5593:x1876361749758464:12345-192.168.206.9@tcp:35:ldlm_bl.0 Request processed in 381us (1785us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1789438267.667979:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:3.0:1789438267.672688:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438267.673224:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749758592 00000100:00100000:0.0:1789438267.673247:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749758592 00010000:00010000:0.0:1789438267.673292:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9250e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa21b expref: 41 pid: 7624 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438267.673339:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 39 00000100:00100000:0.0:1789438267.673351:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+41:2353:x1876361749758592:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789438267.673366:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438267.673374:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9250e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa21b expref: 41 pid: 7624 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.673388:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9250e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa21b expref: 41 pid: 7624 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.673411:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9250e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa21b expref: 41 pid: 7624 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.673427:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:0.0:1789438267.673433:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925110 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.673442:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925110 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.673463:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925110 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.673500:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438267.673556:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+40:2353:x1876361749758592:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 208us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438267.673564:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 39 00010000:00010000:2.0:1789438267.673733:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925110 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.673743:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925110 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438267.673788:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789438267.673799:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789438267.673849:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925110 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.673863:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925110 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.673872:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb925102 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.673878:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb925102 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.673885:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb925102 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.673890:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d62600 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438267.673894:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb925102 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.673902:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb925102 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.673910:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:2.0:1789438267.673913:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438267.673917:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb925102 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.673923:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb925102 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.673935:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.673956:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925109 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.673962:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925109 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.673966:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d62c00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438267.673970:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925109 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.673975:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925109 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.673983:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9991c3ac2600) 00010000:00010000:2.0:1789438267.673986:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438267.673989:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925109 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.673996:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925109 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.674037:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb9250fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa222 expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.674050:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925110 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa222 expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438267.674057:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:2.0:1789438267.674059:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789438267.674068:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63400, rc 0) 00000100:00100000:2.0:1789438267.674095:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+39:10377:x1876361749758208:12345-192.168.206.9@tcp:101:stat.0 Request processed in 14062us (14711us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438267.674103:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 53 00000100:00100000:2.0:1789438267.751131:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438267.751307:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749758848 00000100:00100000:1.0:1789438267.751317:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749758848 00000100:00100000:1.0:1789438267.751429:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 54 00000100:00100000:1.0:1789438267.751441:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+39:10383:x1876361749758848:12345-192.168.206.9@tcp:36:truncate.0 00010000:00010000:1.0:1789438267.751501:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438267.751530:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925110 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa222 expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438267.751550:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:1.0:1789438267.751555:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789438267.751852:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925117 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438267.751866:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438267.751876:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789438267.751927:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1789438267.751952:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000650cdcad reply state 000000000ff6ac95 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438267.751960:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789438267.752093:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+41:10383:x1876361749758848:12345-192.168.206.9@tcp:36:truncate.0 Request processed in 654us (979us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1789438267.752100:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 54 00000020:00080000:1.0:1789438267.752105:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789438267.757028:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438267.757055:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925117 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438267.757063:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925117 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438267.757068:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dbe00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438267.757073:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925117 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438267.757080:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925117 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438267.757097:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:3.0:1789438267.757100:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789438267.757105:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925117 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438267.757138:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925117 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438267.881326:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438267.881427:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749758976 00000100:00100000:0.0:1789438267.881438:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749758976 00000100:00100000:0.0:1789438267.881501:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 55 00000100:00100000:0.0:1789438267.881511:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+40:10397:x1876361749758976:12345-192.168.206.9@tcp:101:stat.0 00010000:00010000:0.0:1789438267.881536:0:7624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438267.881570:0:7624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb92511e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa229 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.881652:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925125 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.881667:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925125 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.881678:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925125 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.881692:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92512c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.881698:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92512c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.881765:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92512c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.881852:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925133 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.881861:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.881867:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438267.881903:0:7624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1789438267.881907:0:7624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789438267.881931:0:7624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.881942:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.881950:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925125 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.881957:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925125 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.881964:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925125 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.881970:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63e00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438267.881975:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925125 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.881988:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925125 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.882012:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:0.0:1789438267.882016:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438267.882021:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925125 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.882027:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925125 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.882052:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92512c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.882058:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92512c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.882065:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92512c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.882070:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438267.882073:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92512c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.882078:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92512c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.882085:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9991c3ac2b00) 00010000:00010000:0.0:1789438267.882087:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438267.882089:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92512c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.882105:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92512c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.882152:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb92511e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa229 expref: 42 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.882165:0:7624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925133 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa229 expref: 41 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438267.882172:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:0.0:1789438267.882175:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789438267.882177:0:7624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63800, rc 0) 00000100:00100000:0.0:1789438267.882246:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+41:10397:x1876361749758976:12345-192.168.206.9@tcp:101:stat.0 Request processed in 736us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438267.882254:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 55 00000100:00100000:2.0:1789438267.985692:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438267.988042:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749759232 00000100:00100000:3.0:1789438267.988058:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749759232 00000100:00100000:3.0:1789438267.988205:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 56 00000100:00100000:3.0:1789438267.988218:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+41:10407:x1876361749759232:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:3.0:1789438267.988239:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438267.988260:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92513a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa230 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789438267.988347:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789438267.988527:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92513a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa230 expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438267.988542:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991c3ac2e00) 00010000:00010000:3.0:1789438267.988545:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789438267.988628:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92513a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa230 expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438267.988647:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a54800, rc 0) 00000100:00100000:3.0:1789438267.988800:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+42:10407:x1876361749759232:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 584us (3116us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1789438267.988808:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 56 00000100:00100000:3.0:1789438267.999192:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438267.999814:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749759488 00000100:00100000:0.0:1789438267.999825:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749759488 00000100:00100000:0.0:1789438267.999892:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 14 00000100:00100000:0.0:1789438267.999903:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+42:10407:x1876361749759488:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:0.0:1789438268.000326:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+43:10407:x1876361749759488:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 423us (1150us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1789438268.000335:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 14 00000100:00100000:2.0:1789438268.066797:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438268.067085:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749759744 00000100:00100000:0.0:1789438268.067095:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749759744 00000100:00100000:0.0:1789438268.067170:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 57 00000100:00100000:0.0:1789438268.067187:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa7cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+43:10413:x1876361749759744:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:0.0:1789438268.067220:0:7624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1789438268.067395:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789438268.067437:0:7624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925148 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa237 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.067532:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92514f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.067546:0:7624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925133 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa229 expref: 44 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.067619:0:7624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92514f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.067652:0:7624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925133 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa229 expref: 44 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.067665:0:7624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925133 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa229 expref: 44 pid: 7624 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438268.067678:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7db5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7624:1876361769711744:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789438268.067880:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f44a7900 going to sleep for 11 seconds 00000100:00100000:2.0:1789438268.076328:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438268.076546:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749759872 00000100:00100000:1.0:1789438268.076569:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749759872 00010000:00010000:1.0:1789438268.076619:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925133 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa229 expref: 45 pid: 7624 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438268.076680:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 40 00000100:00100000:1.0:1789438268.076691:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa7cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+45:2353:x1876361749759872:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789438268.076740:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438268.076749:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925133 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa229 expref: 45 pid: 7624 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.076762:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925133 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa229 expref: 45 pid: 7624 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.076785:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:1.0:1789438268.076790:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92514f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.076800:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92514f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.076808:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92514f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.076829:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438268.076896:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa7cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+45:2353:x1876361749759872:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 206us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438268.076904:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 40 00010000:00010000:0.0:1789438268.077326:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925133 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa229 expref: 44 pid: 7624 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438268.077345:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7db5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7624:1876361769711744:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438268.077365:0:7624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92514f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.077387:0:7624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92514f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.077393:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92514f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438268.077412:0:7624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1789438268.077568:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925148 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa237 expref: 45 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.077585:0:7624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92514f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa237 expref: 44 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.077592:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:0.0:1789438268.077595:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789438268.077598:0:7624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63000, rc 0) 00000100:00100000:0.0:1789438268.077630:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa7cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+44:10413:x1876361749759744:12345-192.168.206.9@tcp:101:bash.0 Request processed in 10446us (10843us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1789438268.077638:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 57 00000100:00100000:3.0:1789438268.080855:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438268.081010:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749760128 00000100:00100000:1.0:1789438268.081021:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749760128 00000100:00100000:1.0:1789438268.081143:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 58 00000100:00100000:1.0:1789438268.081155:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+44:10413:x1876361749760128:12345-192.168.206.9@tcp:36:bash.0 00010000:00010000:1.0:1789438268.081973:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb92515d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.081993:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb92515d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.082005:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb92515d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789438268.082832:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1789438268.082887:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000107cb8da reply state 00000000cbb0faf0 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb92515d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438268.082898:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789438268.083012:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+47:10413:x1876361749760128:12345-192.168.206.9@tcp:36:bash.0 Request processed in 1856us (2174us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1789438268.083020:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 58 00000020:00080000:1.0:1789438268.083027:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789438268.085485:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb92515d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.085501:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb92515d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.085509:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb92515d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.085515:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9da000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438268.085520:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb92515d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.085528:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb92515d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.085546:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:2.0:1789438268.085549:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438268.085574:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb92515d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.085581:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb92515d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438268.088950:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438268.089042:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749760256 00000100:00100000:2.0:1789438268.089051:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749760256 00000100:00100000:2.0:1789438268.089116:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 59 00000100:00100000:2.0:1789438268.089127:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+46:10413:x1876361749760256:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:2.0:1789438268.089155:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438268.089187:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb925164 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa23e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.089280:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb92516b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.089295:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92514f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa237 expref: 47 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.089303:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb92516b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.089338:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92514f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa237 expref: 47 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.089352:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92514f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa237 expref: 47 pid: 7624 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438268.089365:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa7ce300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876361769711872:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789438268.089448:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c6d5d180 going to sleep for 11 seconds 00000100:00100000:3.0:1789438268.092103:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438268.092257:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749760384 00000100:00100000:0.0:1789438268.092267:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749760384 00010000:00010000:0.0:1789438268.092306:0:8438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92514f lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa237 expref: 48 pid: 7624 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438268.092350:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 41 00000100:00100000:0.0:1789438268.092359:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1274be99-2d57-4dac-a13e-a89426512ee0+48:2353:x1876361749760384:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789438268.092373:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789438268.092378:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa7ce300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876361769711872:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438268.092387:0:8438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92514f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa237 expref: 48 pid: 7624 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.092398:0:8438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92514f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa237 expref: 48 pid: 7624 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.094028:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb92516b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.094052:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92514f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa237 expref: 48 pid: 7624 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.094075:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:0.0:1789438268.094080:0:8438:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb92516b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.094091:0:8438:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb92516b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.094099:0:8438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb92516b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.094135:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789438268.094144:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb92516b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.094150:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb92516b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438268.094331:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1274be99-2d57-4dac-a13e-a89426512ee0+47:2353:x1876361749760384:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 1971us (2235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438268.094340:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 41 00000004:00200000:2.0:1789438268.095351:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789438268.095357:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789438268.095383:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb92516b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.095421:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb925164 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa23e expref: 47 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.095438:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb92516b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa23e expref: 46 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.095446:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:2.0:1789438268.095450:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789438268.095453:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f0800, rc 0) 00000100:00100000:2.0:1789438268.095561:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+46:10413:x1876361749760256:12345-192.168.206.9@tcp:101:bash.0 Request processed in 6427us (6610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438268.095568:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 59 00000100:00100000:3.0:1789438268.098647:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438268.100221:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749760640 00000100:00100000:0.0:1789438268.100235:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749760640 00000100:00100000:0.0:1789438268.100292:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:0.0:1789438268.100303:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d21bb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+46:10413:x1876361749760640:12345-192.168.206.9@tcp:35:bash.0 00000100:00100000:0.0:1789438268.100524:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d21bb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+47:10413:x1876361749760640:12345-192.168.206.9@tcp:35:bash.0 Request processed in 223us (1885us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1789438268.100547:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:3.0:1789438268.199634:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438268.199736:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749760896 00000100:00100000:1.0:1789438268.199747:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749760896 00000100:00100000:1.0:1789438268.199802:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 60 00000100:00100000:1.0:1789438268.199811:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+47:10423:x1876361749760896:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438268.199832:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438268.199861:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925172 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa245 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438268.199940:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789438268.200053:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925172 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa245 expref: 49 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.200085:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991c3ac2e00) 00010000:00010000:1.0:1789438268.200088:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789438268.200093:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925172 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa245 expref: 49 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.200114:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9dba00, rc 0) 00000100:00100000:1.0:1789438268.200170:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+48:10423:x1876361749760896:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 360us (543us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1789438268.200177:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 60 00000100:00100000:3.0:1789438268.204752:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438268.205180:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749761024 00000100:00100000:0.0:1789438268.205192:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749761024 00000100:00100000:0.0:1789438268.205257:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 61 00000100:00100000:0.0:1789438268.205268:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+48:10423:x1876361749761024:12345-192.168.206.9@tcp:34:lfs.0 00010000:00010000:0.0:1789438268.205342:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925180 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.205358:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925180 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.205370:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925180 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.205385:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925187 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.205392:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.205410:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.205501:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb92518e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.205510:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb92518e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.205516:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb92518e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789438268.205587:0:7624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb92518e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.205602:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925180 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.205609:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925180 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.205615:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925180 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.205621:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438268.205625:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925180 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.205632:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925180 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.205646:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:0.0:1789438268.205649:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438268.205655:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925180 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.205661:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925180 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.205675:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.205680:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925187 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.205692:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.205697:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63200 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438268.205700:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.206846:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925187 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.206868:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9991c3ac2b00) 00010000:00010000:0.0:1789438268.206871:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438268.206875:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925187 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.206882:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925187 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.206904:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb92518e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.206911:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb92518e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.206917:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb92518e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.206923:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438268.206926:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb92518e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.206948:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb92518e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.206956:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:0.0:1789438268.206958:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438268.206962:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb92518e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438268.206968:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb92518e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438268.207063:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+48:10423:x1876361749761024:12345-192.168.206.9@tcp:34:lfs.0 Request processed in 1793us (2315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438268.207071:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 61 00000100:00100000:3.0:1789438268.209802:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438268.209940:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749761280 00000100:00100000:0.0:1789438268.209950:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749761280 00000100:00100000:0.0:1789438268.210006:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:0.0:1789438268.210016:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+48:10423:x1876361749761280:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:0.0:1789438268.210270:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+49:10423:x1876361749761280:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 255us (476us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1789438268.210278:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:3.0:1789438268.251814:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438268.251918:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749761536 00000100:00100000:1.0:1789438268.251928:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749761536 00000100:00100000:1.0:1789438268.251989:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 62 00000100:00100000:1.0:1789438268.252009:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+49:10426:x1876361749761536:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438268.252035:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438268.252062:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925195 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa24c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.252145:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb92519c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.252161:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb92519c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.252173:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb92519c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.252189:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9251a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.252211:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9251a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.252218:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9251a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.252335:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9251aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.252344:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9251aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.252350:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9251aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438268.252360:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789438268.252460:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb92519c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.252468:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb92519c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.252476:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb92519c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.252482:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9da200 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438268.252486:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb92519c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.252494:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb92519c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.252515:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:1.0:1789438268.252518:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438268.252524:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb92519c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.252531:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb92519c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.252544:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9251a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.252770:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9251a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.252779:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9251a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.252940:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9da000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438268.252943:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9251a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.252951:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9251a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.252961:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9991c7c83500) 00010000:00010000:1.0:1789438268.252963:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438268.252967:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9251a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.252974:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9251a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.253199:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925195 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa24c expref: 52 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.253215:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9251aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa24c expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.253222:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:1.0:1789438268.253224:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789438268.253227:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9dbe00, rc 0) 00000100:00100000:1.0:1789438268.253338:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+51:10426:x1876361749761536:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 1339us (1532us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1789438268.253346:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 62 00000100:00100000:3.0:1789438268.262749:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438268.262782:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438268.262858:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749761664 00000100:00100000:1.0:1789438268.262868:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749761664 00000100:00100000:1.0:1789438268.262930:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:1.0:1789438268.262939:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+51:2354:x1876361749761664:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789438268.262953:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438268.262976:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9251aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa24c expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.262991:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:1.0:1789438268.262996:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438268.263056:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+50:2354:x1876361749761664:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 117us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438268.263064:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:2.0:1789438268.263957:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749761792 00000100:00100000:2.0:1789438268.263968:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749761792 00000100:00100000:2.0:1789438268.264020:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 63 00000100:00100000:2.0:1789438268.264029:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+50:10426:x1876361749761792:12345-192.168.206.9@tcp:54:lfs.0 00010000:00010000:2.0:1789438268.264196:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb9251b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.264223:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb9251b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.264234:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb9251b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.264259:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb9251b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.264265:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb9251b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.264271:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb9251b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.264277:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438268.264281:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb9251b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.264288:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb9251b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.264297:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:2.0:1789438268.264300:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789438268.264303:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb9251b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.264310:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb9251b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438268.264361:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+50:10426:x1876361749761792:12345-192.168.206.9@tcp:54:lfs.0 Request processed in 333us (1577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438268.264374:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 63 00000100:00100000:2.0:1789438268.272160:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438268.272252:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749762048 00000100:00100000:0.0:1789438268.272263:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749762048 00000100:00100000:0.0:1789438268.272321:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 17 00000100:00100000:0.0:1789438268.272332:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa7ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+50:10426:x1876361749762048:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:0.0:1789438268.272563:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa7ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+51:10426:x1876361749762048:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 232us (411us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1789438268.272587:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 17 00010000:00010000:2.0:1789438268.280822:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438268.456884:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438268.457074:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749762304 00000100:00100000:1.0:1789438268.457096:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749762304 00000100:00100000:1.0:1789438268.457165:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 64 00000100:00100000:1.0:1789438268.457176:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+51:10444:x1876361749762304:12345-192.168.206.9@tcp:101:cat.0 00010000:00010000:1.0:1789438268.457200:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438268.457221:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9251bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa253 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.457317:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9251c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.457333:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9251c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.457345:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9251c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438268.457357:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789438268.457477:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9251bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa253 expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.457497:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9251c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa253 expref: 53 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.457507:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:1.0:1789438268.457509:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789438268.457513:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9dba00, rc 0) 00000100:00100000:1.0:1789438268.457577:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+53:10444:x1876361749762304:12345-192.168.206.9@tcp:101:cat.0 Request processed in 403us (702us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1789438268.457584:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 64 00000100:00100000:3.0:1789438268.489210:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438268.489613:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749762432 00000100:00100000:1.0:1789438268.489624:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749762432 00000100:00100000:1.0:1789438268.489689:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 65 00000100:00100000:1.0:1789438268.489700:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+53:10445:x1876361749762432:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438268.489749:0:7624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438268.489771:0:7624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9251d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa25a expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.489850:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9251db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.489863:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9251db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.489874:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9251db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438268.489906:0:7624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789438268.489910:0:7624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789438268.489926:0:7624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9251db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.489951:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9251d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa25a expref: 55 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.489970:0:7624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9251db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa25a expref: 54 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.489978:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:1.0:1789438268.489981:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789438268.489997:0:7624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9da000, rc 0) 00000100:00100000:1.0:1789438268.490331:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+54:10445:x1876361749762432:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 631us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438268.490340:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 65 00000100:00100000:2.0:1789438268.500807:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438268.500890:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749762816 00000100:00100000:0.0:1789438268.500900:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749762816 00000100:00100000:0.0:1789438268.500966:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 18 00000100:00100000:0.0:1789438268.500977:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+54:10445:x1876361749762816:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:0.0:1789438268.501582:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+55:10445:x1876361749762816:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 603us (781us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1789438268.501592:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 18 00000100:00100000:0.0:1789438268.506239:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438268.506332:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749762944 00000100:00100000:1.0:1789438268.506343:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749762944 00000100:00100000:1.0:1789438268.506409:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 5 00000100:00100000:1.0:1789438268.506421:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7db6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+55:10445:x1876361749762944:12345-192.168.206.9@tcp:103:lfs.0 00010000:00010000:1.0:1789438268.506438:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789438268.506464:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb92516b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa23e expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.506488:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9251c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa253 expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.506502:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb925076 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1ff expref: 53 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.506513:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:1.0:1789438268.506523:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438268.506580:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7db6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+52:10445:x1876361749762944:12345-192.168.206.9@tcp:103:lfs.0 Request processed in 161us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438268.506588:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 5 00000100:00100000:3.0:1789438268.512401:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438268.512555:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749763072 00000100:00100000:1.0:1789438268.512566:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749763072 00000100:00100000:1.0:1789438268.512630:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 66 00000100:00100000:1.0:1789438268.512641:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+52:10445:x1876361749763072:12345-192.168.206.9@tcp:58:lfs.0 00010000:00010000:1.0:1789438268.512799:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9251e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.512817:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9251e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.512830:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9251e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789438268.513170:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789438268.513390:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1789438268.513462:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1789438268.513573:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+52:10445:x1876361749763072:12345-192.168.206.9@tcp:58:lfs.0 Request processed in 931us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438268.513583:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 66 00000100:00100000:2.0:1789438268.535271:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438268.535367:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749763200 00000100:00100000:1.0:1789438268.535377:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749763200 00000100:00100000:1.0:1789438268.535429:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 67 00000100:00100000:1.0:1789438268.535439:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa7cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+52:10447:x1876361749763200:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438268.535459:0:7624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438268.535477:0:7624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9251e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa261 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.535536:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9251f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.535551:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9251f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.535572:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9251f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.535599:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb9251f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.535606:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb9251f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.535613:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb9251f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.535690:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9251fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.535699:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9251fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.535742:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9251fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438268.535774:0:7624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789438268.535778:0:7624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789438268.535794:0:7624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9251fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.535804:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9251fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.535813:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9251f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.535820:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9251f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.535846:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9251f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.535853:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9da200 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438268.535857:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9251f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.535865:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9251f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.535877:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:1.0:1789438268.535879:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438268.535884:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9251f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.535890:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9251f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.535903:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb9251f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.535908:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb9251f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.535914:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb9251f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.535919:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dae00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438268.535922:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb9251f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.535935:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb9251f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.535943:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9991c7c83000) 00010000:00010000:1.0:1789438268.535945:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438268.535947:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb9251f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.535952:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb9251f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.535982:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9251e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa261 expref: 54 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.535996:0:7624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9251fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa261 expref: 53 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.536003:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991c7c83500) 00010000:00010000:1.0:1789438268.536005:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789438268.536007:0:7624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9da600, rc 0) 00000100:00100000:1.0:1789438268.536065:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa7cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+53:10447:x1876361749763200:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 628us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438268.536072:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 67 00000100:00100000:2.0:1789438268.733609:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa7cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769712000:0@lo:400:kworker.0 00000100:00100000:2.0:1789438268.733684:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438268.733754:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa7ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876361769712512:0@lo:400:kworker.0 00000100:00100000:2.0:1789438268.733782:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438268.733812:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789438268.733819:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa7cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769712384:0@lo:400:kworker.0 00000100:00100000:2.0:1789438268.733842:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438268.733873:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa7cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876361769712128:0@lo:400:kworker.0 00000100:00100000:2.0:1789438268.733894:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438268.733912:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa7cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769712640:0@lo:400:kworker.0 00000100:00100000:2.0:1789438268.733933:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438268.733950:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789438268.733956:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa7cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769712256:0@lo:400:kworker.0 00000100:00100000:2.0:1789438268.733977:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438268.734010:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769712000 00000100:00100000:2.0:1789438268.734018:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769712000 00000100:00100000:2.0:1789438268.734061:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789438268.734070:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3310:x1876361769712000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438268.734130:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3310:x1876361769712000:12345-0@lo:400:kworker.0 Request processed in 61us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438268.734154:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789438268.734337:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769712512 00000100:00100000:2.0:1789438268.734342:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769712512 00000100:00100000:2.0:1789438268.734471:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769712128 00000100:00100000:2.0:1789438268.734475:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769712128 00000100:00100000:2.0:1789438268.734491:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769712256 00000100:00100000:2.0:1789438268.734494:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769712256 00000100:00100000:2.0:1789438268.734514:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789438268.734521:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa7cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876361769712512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438268.734557:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa7cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876361769712512:12345-0@lo:400:kworker.0 Request processed in 37us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438268.734563:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789438268.734576:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789438268.734582:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa7cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876361769712128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438268.734614:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa7cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876361769712128:12345-0@lo:400:kworker.0 Request processed in 32us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438268.734620:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789438268.734632:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789438268.734639:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa7cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769712256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438268.734666:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa7cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769712256:12345-0@lo:400:kworker.0 Request processed in 28us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438268.734671:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789438268.734690:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769712384 00000100:00100000:2.0:1789438268.734693:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769712384 00000100:00100000:2.0:1789438268.734746:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769712640 00000100:00100000:2.0:1789438268.734750:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769712640 00000100:00100000:2.0:1789438268.734773:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789438268.734787:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa7ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1876361769712384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438268.734819:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa7ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1876361769712384:12345-0@lo:400:kworker.0 Request processed in 33us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438268.734824:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789438268.734836:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789438268.734842:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa7cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769712640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438268.734867:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa7cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769712640:12345-0@lo:400:kworker.0 Request processed in 26us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438268.734874:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1789438268.734894:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789438268.734898:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789438268.734901:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789438268.735448:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa7cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769712256:0@lo:400:kworker.0 00000100:00100000:2.0:1789438268.735465:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa7cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876361769712128:0@lo:400:kworker.0 00000100:00100000:2.0:1789438268.735475:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa7cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769712640:0@lo:400:kworker.0 00000100:00100000:2.0:1789438268.735523:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa7cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769712384:0@lo:400:kworker.0 00000100:00100000:2.0:1789438268.735533:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa7cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769712000:0@lo:400:kworker.0 00000100:00100000:2.0:1789438268.735542:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa7ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876361769712512:0@lo:400:kworker.0 00000001:00080000:1.0:1789438268.824603:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000020:00080000:1.0:1789438268.824645:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9991f44a7540 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1789438268.824650:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9991d1ae9000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9991f44a7d80 00000020:00080000:1.0:1789438268.824654:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9991d1ae9100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9991c7db3c00 00000004:00080000:1.0:1789438268.824954:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1789438268.824994:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1789438268.825147:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1789438268.825446:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f47d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769712768:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789438268.825511:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438268.825581:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769712768 00000100:00100000:1.0:1789438268.825589:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769712768 00000100:00100000:1.0:1789438268.825635:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789438268.825645:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1876361769712768:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789438268.825673:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1789438268.825936:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa8a93a, atime: 0x6aa8a93a, ctime: 0x6aa8a93a, blocks: 0xb 00010000:00010000:1.0:1789438268.825946:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb925205 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.825963:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=321s v=(0 0) 00010000:00010000:1.0:1789438268.825967:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438268.825974:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb925205 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.825992:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb925205 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.826002:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb925205 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.826010:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb925205 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438268.826555:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789438268.827592:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1876361769712768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1942us (2074us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789438268.827604:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:0.0:1789438268.832654:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9991f47d9180/2, rc 0, transno 4294967301 00000100:00100000:0.0:1789438268.832670:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f47d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769712768:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789438268.835948:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789438268.835962:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb925205 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.835977:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dae00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:2.0:1789438268.835982:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb925205 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.836006:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb925205 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.836043:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb925205 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.836050:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb925205 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.836070:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438268.836072:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438268.836073:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789438268.919279:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789438268.919289:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789438268.919363:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789438268.919370:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789438268.919502:0:11668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7db5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11668:1876361769712896:192.168.206.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789438268.919604:0:11668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d019cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789438268.925999:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438268.926151:0:11668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7db5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11668:1876361769712896:192.168.206.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789438268.927774:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749763328 00000100:00100000:1.0:1789438268.927789:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749763328 00000100:00100000:1.0:1789438268.927862:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 1 00000100:00100000:1.0:1789438268.927873:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1274be99-2d57-4dac-a13e-a89426512ee0+11:10458:x1876361749763328:12345-192.168.206.9@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789438268.927970:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1274be99-2d57-4dac-a13e-a89426512ee0+11:10458:x1876361749763328:12345-192.168.206.9@tcp:900:lhsmtool_posix.0 Request processed in 98us (1980us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438268.927977:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 1 00000100:00100000:3.0:1789438268.940675:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438268.941092:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749763456 00000100:00100000:2.0:1789438268.941113:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749763456 00000100:00100000:2.0:1789438268.941183:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 68 00000100:00100000:2.0:1789438268.941195:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+11:10458:x1876361749763456:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789438268.941228:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789438268.941375:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+11:10458:x1876361749763456:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 Request processed in 182us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438268.941384:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 68 00000100:00100000:0.0:1789438268.964031:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438268.964140:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749763584 00000100:00100000:2.0:1789438268.964151:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749763584 00000100:00100000:2.0:1789438268.964220:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 69 00000100:00100000:2.0:1789438268.964231:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+11:10458:x1876361749763584:12345-192.168.206.9@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789438268.964301:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb92520c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.964332:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb92520c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.964347:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb92520c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.964364:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925213 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.964372:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925213 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.964380:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925213 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.964409:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92521a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.964418:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92521a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.964425:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92521a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438268.964461:0:7624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789438268.964466:0:7624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789438268.964478:0:7624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92521a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.964490:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb92520c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.964506:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb92520c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.964513:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb92520c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.964519:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0e00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438268.964523:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb92520c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.964531:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb92520c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.964543:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9991d5872000) 00010000:00010000:2.0:1789438268.964546:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438268.964551:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb92520c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.964557:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb92520c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.964572:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925213 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.964578:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925213 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.964583:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925213 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.964588:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f1400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438268.964598:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925213 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.964604:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925213 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.964612:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9991d5872600) 00010000:00010000:2.0:1789438268.964614:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438268.964617:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925213 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.964622:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925213 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.964637:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92521a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.964643:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92521a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.964648:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92521a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.964652:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f1800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438268.964654:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92521a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.964659:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92521a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.964665:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991c7c83500) 00010000:00010000:2.0:1789438268.964667:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438268.964676:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92521a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.964682:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92521a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438268.964988:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+11:10458:x1876361749763584:12345-192.168.206.9@tcp:34:lhsmtool_posix.0 Request processed in 756us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438268.964998:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 69 00000100:00100000:0.0:1789438268.969515:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438268.972117:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749763840 00000100:00100000:2.0:1789438268.972134:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749763840 00000100:00100000:2.0:1789438268.972210:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 70 00000100:00100000:2.0:1789438268.972221:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+11:10458:x1876361749763840:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789438268.972240:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438268.972261:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb925221 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa268 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.972358:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925228 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.972372:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925228 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.972384:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925228 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438268.972395:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789438268.972589:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925228 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.972597:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925228 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.972618:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925228 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.972624:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438268.972629:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925228 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.972637:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925228 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.972649:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991c7c83500) 00010000:00010000:2.0:1789438268.972653:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789438268.972657:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925228 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.972664:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925228 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.972733:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb925221 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa268 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.972744:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9991d5872000) 00010000:00010000:2.0:1789438268.972747:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789438268.972750:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb925221 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa268 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.972777:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f1600, rc 0) 00000100:00100000:2.0:1789438268.972841:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+12:10458:x1876361749763840:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 622us (3335us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1789438268.972858:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 70 00000100:00100000:0.0:1789438268.980373:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438268.980524:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749763968 00000100:00100000:1.0:1789438268.980536:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749763968 00000100:00100000:1.0:1789438268.980596:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 71 00000100:00100000:1.0:1789438268.980607:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+12:10458:x1876361749763968:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789438268.980643:0:5840:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789438268.981009:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+12:10458:x1876361749763968:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 Request processed in 403us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438268.981018:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 71 00000100:00100000:0.0:1789438268.989939:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438268.991063:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749764224 00000100:00100000:2.0:1789438268.991076:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749764224 00000100:00100000:2.0:1789438268.991323:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 72 00000100:00100000:2.0:1789438268.991335:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+12:10458:x1876361749764224:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789438268.991355:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438268.991358:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789438268.991384:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9251db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa25a expref: 12 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.991402:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:2.0:1789438268.991408:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789438268.991423:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb925236 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa26f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789438268.992953:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1789438268.993292:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb92523d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.993308:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb92523d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.993321:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb92523d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.993382:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb925236 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa26f expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.993411:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb92523d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa26f expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438268.993420:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9991d5872600) 00010000:00010000:2.0:1789438268.993423:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789438268.993426:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f0800, rc 0) 00000100:00100000:2.0:1789438268.993496:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+13:10458:x1876361749764224:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 2162us (3566us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1789438268.993505:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 72 00000100:00100000:0.0:1789438269.000492:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438269.000666:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749764480 00000100:00100000:2.0:1789438269.000676:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749764480 00000100:00100000:2.0:1789438269.000758:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 73 00000100:00100000:2.0:1789438269.000769:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+13:10458:x1876361749764480:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789438269.000837:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438269.000862:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb92523d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa26f expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.000879:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9991d5872600) 00010000:00010000:2.0:1789438269.000889:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789438269.000910:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92524b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.000923:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92524b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.000932:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92524b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.000952:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925252 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x94ef365d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.000959:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925252 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x94ef365d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.000964:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925252 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x94ef365d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.001180:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92524b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.001189:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92524b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.001196:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92524b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.001202:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f1400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438269.001206:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92524b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.001214:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92524b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.001223:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:2.0:1789438269.001226:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438269.001229:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92524b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.001235:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92524b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.001252:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925252 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x94ef365d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.001257:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925252 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x94ef365d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.001263:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925252 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x94ef365d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.001280:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0e00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438269.001283:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925252 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x94ef365d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.001289:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925252 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x94ef365d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.001296:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x94ef365d (ffff9991d5872900) 00010000:00010000:2.0:1789438269.001299:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438269.001302:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925252 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x94ef365d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.001307:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925252 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x94ef365d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438269.001509:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+12:10458:x1876361749764480:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 740us (1024us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789438269.001517:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 73 00000100:00100000:2.0:1789438269.009681:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438269.009854:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749764608 00000100:00100000:0.0:1789438269.009877:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749764608 00000100:00100000:0.0:1789438269.009940:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 74 00000100:00100000:0.0:1789438269.009951:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa7ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+12:10458:x1876361749764608:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789438269.009972:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438269.009999:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb925259 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa276 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.010044:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925260 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.010057:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.010070:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.010177:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb925259 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa276 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.010196:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925260 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa276 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.010204:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9991c3ac2800) 00010000:00010000:0.0:1789438269.010207:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789438269.010211:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63c00, rc 0) 00000100:00100000:0.0:1789438269.010266:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa7ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+13:10458:x1876361749764608:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 317us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438269.010273:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 74 00000100:00100000:0.0:1789438269.014666:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438269.014789:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749764864 00000100:00100000:2.0:1789438269.014799:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749764864 00000100:00100000:2.0:1789438269.014864:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 75 00000100:00100000:2.0:1789438269.014874:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+13:10458:x1876361749764864:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789438269.014950:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925267 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.014966:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925267 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.014978:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925267 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789438269.015327:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1789438269.015337:0:7624:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 321280628782ns, next at 322280626627ns, rc = 0 00000004:00010000:2.0:1789438269.015437:0:7624:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005acac8cb reply state 00000000fdbe656a transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925267 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438269.015446:0:7624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789438269.015544:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+15:10458:x1876361749764864:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 671us (884us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1789438269.015550:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 75 00000100:00100000:2.0:1789438269.019782:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438269.019817:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749764992 00000100:00100000:2.0:1789438269.019827:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749764992 00000100:00100000:2.0:1789438269.019878:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 76 00000100:00100000:2.0:1789438269.019890:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+15:10458:x1876361749764992:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789438269.019915:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438269.019936:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92526e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa27d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.020011:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92526e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa27d expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.020026:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92526e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa27d expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.020044:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9991c3ac2800) 00010000:00010000:2.0:1789438269.020047:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789438269.020051:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f1400, rc 0) 00000100:00100000:2.0:1789438269.020123:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+16:10458:x1876361749764992:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 219us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438269.020131:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 76 00010000:00010000:1.0:1789438269.023569:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925267 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.023588:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925267 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.023596:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925267 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.023609:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0e00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438269.023616:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925267 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.023624:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925267 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.023641:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9991c3ac2800) 00010000:00010000:1.0:1789438269.023644:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789438269.023648:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925267 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.023655:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925267 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438269.041511:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438269.041787:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749765120 00000100:00100000:2.0:1789438269.041798:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749765120 00000100:00100000:2.0:1789438269.041888:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 25 00000100:00100000:2.0:1789438269.041899:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1876361749765120:12345-192.168.206.9@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1789438269.041933:0:8192:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 1274be99-2d57-4dac-a13e-a89426512ee0@192.168.206.9@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:2.0:1789438269.041965:0:8192:0:(genops.c:1384:class_connect()) connect: client 1274be99-2d57-4dac-a13e-a89426512ee0, cookie 0x7a8dd0fcbb925275 00002000:00100000:2.0:1789438269.041976:0:8192:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1274be99-2d57-4dac-a13e-a89426512ee0/ffff9991e1e96800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789438269.041998:0:8192:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:2.0:1789438269.042265:0:8192:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789438269.042294:0:8192:0:(import.c:65:import_set_state_nolock()) ffff9991e1e96000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789438269.042361:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1274be99-2d57-4dac-a13e-a89426512ee0+6:2352:x1876361749765120:12345-192.168.206.9@tcp:8:lhsmtool_posix.0 Request processed in 462us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438269.042380:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 25 00000100:00100000:3.0:1789438269.050779:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438269.050985:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749765248 00000100:00100000:1.0:1789438269.050996:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749765248 00000100:00100000:1.0:1789438269.051077:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 26 00000100:00100000:1.0:1789438269.051089:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+6:0:x1876361749765248:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789438269.052981:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789438269.126977:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+7:0:x1876361749765248:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 Request processed in 75880us (76197us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789438269.126992:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 26 00000001:00080000:1.0:1789438269.127028:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:1.0:1789438269.127052:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1274be99-2d57-4dac-a13e-a89426512ee0 00000100:00100000:1.0:1789438269.130804:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438269.134160:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749765504 00000100:00100000:0.0:1789438269.134176:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749765504 00000100:00100000:0.0:1789438269.135555:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 19 00000100:00100000:0.0:1789438269.135573:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+15:10458:x1876361749765504:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789438269.135841:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+16:10458:x1876361749765504:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 Request processed in 273us (5044us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1789438269.135850:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 19 00000100:00100000:2.0:1789438269.139330:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438269.139363:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749765760 00000100:00100000:2.0:1789438269.139373:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749765760 00000100:00100000:2.0:1789438269.139431:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 77 00000100:00100000:2.0:1789438269.139442:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa7cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+16:10458:x1876361749765760:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789438269.139544:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa7cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+16:10458:x1876361749765760:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 104us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438269.139552:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 77 00000100:00100000:2.0:1789438269.143023:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438269.143119:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749765888 00000100:00100000:0.0:1789438269.143130:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749765888 00000100:00100000:0.0:1789438269.143188:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 78 00000100:00100000:0.0:1789438269.143200:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+16:10458:x1876361749765888:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789438269.143219:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438269.143250:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92527c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa284 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.143318:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925283 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.143332:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.143345:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438269.143379:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789438269.143397:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.143434:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92527c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa284 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.143460:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa284 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.143468:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9991c3ac2800) 00010000:00010000:0.0:1789438269.143470:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789438269.143474:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63000, rc 0) 00000100:00100000:0.0:1789438269.143530:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+17:10458:x1876361749765888:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 333us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438269.143538:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 78 00000100:00100000:1.0:1789438269.149865:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438269.153928:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749766016 00000100:00100000:0.0:1789438269.153943:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749766016 00000100:00100000:2.0:1789438269.154285:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 27 00000100:00100000:2.0:1789438269.154299:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1274be99-2d57-4dac-a13e-a89426512ee0+5:2353:x1876361749766016:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789438269.154317:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438269.154341:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7521a80/0x7a8dd0fcbb92528a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa28b expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789438269.154380:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa8a93c, blocks: 0x1 00010000:00010000:2.0:1789438269.154401:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=321s v=(0 0) 00010000:00010000:2.0:1789438269.154406:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789438269.154415:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7521a80/0x7a8dd0fcbb92528a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa28b expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.154435:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e7521a80/0x7a8dd0fcbb92528a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa28b expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.154461:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f0a00, rc 0) 00000100:00100000:2.0:1789438269.154535:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1274be99-2d57-4dac-a13e-a89426512ee0+6:2353:x1876361749766016:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 240us (4678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438269.154542:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 27 00000100:00100000:3.0:1789438269.160790:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438269.161041:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749766272 00000100:00100000:0.0:1789438269.161052:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749766272 00000100:00100000:0.0:1789438269.161119:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 79 00000100:00100000:0.0:1789438269.161130:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+17:10458:x1876361749766272:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789438269.161537:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+17:10458:x1876361749766272:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 407us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438269.161545:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 79 00000100:00100000:3.0:1789438269.169358:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438269.169433:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749766400 00000100:00100000:2.0:1789438269.169443:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749766400 00000100:00100000:2.0:1789438269.169508:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 28 00000100:00100000:2.0:1789438269.169519:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1274be99-2d57-4dac-a13e-a89426512ee0+6:10458:x1876361749766400:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789438269.169538:0:8192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438269.169557:0:8192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ccc3219/0x7a8dd0fcbb925291 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa292 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.169594:0:8192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7521a80/0x7a8dd0fcbb92528a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa28b expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.169604:0:8192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789438269.169608:0:8192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789438269.169614:0:8192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ccc3219/0x7a8dd0fcbb925291 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa292 expref: 7 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.169656:0:8192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e7521a80/0x7a8dd0fcbb92528a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa28b expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.169670:0:8192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e7521a80/0x7a8dd0fcbb92528a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa28b expref: 7 pid: 6681 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438269.169700:0:8192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa7cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8192:1876361769713024:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789438269.169857:0:8192:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e50b6540 going to sleep for 11 seconds 00000100:00100000:2.0:1789438269.179095:0:8192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa7cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8192:1876361769713024:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789438269.179148:0:8192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ccc3219/0x7a8dd0fcbb925291 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa292 expref: 7 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.179168:0:8192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f0600, rc 0) 00000100:00100000:2.0:1789438269.179326:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1274be99-2d57-4dac-a13e-a89426512ee0+7:10458:x1876361749766400:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 9807us (9976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438269.179335:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 28 00000100:00100000:3.0:1789438269.187329:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438269.191223:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749766528 00000100:00100000:2.0:1789438269.191238:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749766528 00010000:00010000:2.0:1789438269.191281:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e7521a80/0x7a8dd0fcbb92528a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa28b expref: 7 pid: 6681 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438269.191328:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 42 00000100:00100000:2.0:1789438269.191339:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d0512850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+7:2353:x1876361749766528:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789438269.191356:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438269.191377:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e7521a80/0x7a8dd0fcbb92528a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa28b expref: 7 pid: 6681 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.191391:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e7521a80/0x7a8dd0fcbb92528a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa28b expref: 7 pid: 6681 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.191426:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7521a80/0x7a8dd0fcbb92528a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa28b expref: 7 pid: 6681 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.191441:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789438269.191445:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789438269.191453:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ccc3219/0x7a8dd0fcbb925291 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa292 expref: 6 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.191463:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ccc3219/0x7a8dd0fcbb925291 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa292 expref: 6 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.191504:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003ccc3219/0x7a8dd0fcbb925291 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa292 expref: 6 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438269.191517:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa7cdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5823:1876361769713152:192.168.206.9@tcp:105: 00000100:00100000:2.0:1789438269.191598:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e50b6540 going to sleep for 11 seconds 00000100:00100000:2.0:1789438269.203326:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438269.203419:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa7cdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5823:1876361769713152:192.168.206.9@tcp:105: 00010000:00010000:1.0:1789438269.203456:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438269.203516:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d0512850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+6:2353:x1876361749766528:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 12177us (16194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438269.203527:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 42 00000100:00100000:3.0:1789438269.204009:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749766656 00000100:00100000:3.0:1789438269.204019:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749766656 00002000:00100000:3.0:1789438269.204060:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9991fa7cca80 x1876361749766656/t0(0) o4->1274be99-2d57-4dac-a13e-a89426512ee0@192.168.206.9@tcp:700/0 lens 504/0 e 0 to 0 dl 1789438280 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789438269.204071:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9991fa7cca80 with x1876361749766656 ext(0->8) 00002000:00010000:3.0:1789438269.204076:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9991fa7cca80 00000100:00100000:3.0:1789438269.204097:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00100000:3.0:1789438269.204116:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1274be99-2d57-4dac-a13e-a89426512ee0+6:2353:x1876361749766656:12345-192.168.206.9@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789438269.204735:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1274be99-2d57-4dac-a13e-a89426512ee0+8:2353:x1876361749766656:12345-192.168.206.9@tcp:4:lhsmtool_posix.0 Request processed in 628us (1415us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789438269.204743:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 0 00002000:00100000:3.0:1789438269.204751:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9991fa7cca80 x1876361749766656/t4294967302(0) o4->1274be99-2d57-4dac-a13e-a89426512ee0@192.168.206.9@tcp:700/0 lens 504/448 e 0 to 0 dl 1789438280 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789438269.204760:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9991fa7cca80 with x1876361749766656 ext(0->8) 00002000:00010000:3.0:1789438269.204764:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9991fa7cca80 00000100:00100000:2.0:1789438269.208311:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438269.208420:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749766784 00000100:00100000:0.0:1789438269.208430:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749766784 00000100:00100000:0.0:1789438269.208522:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 80 00000100:00100000:0.0:1789438269.208534:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa7cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+17:10458:x1876361749766784:12345-192.168.206.9@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1789438269.238597:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa7cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+17:10458:x1876361749766784:12345-192.168.206.9@tcp:44:lhsmtool_posix.0 Request processed in 30057us (30284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438269.238609:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 80 00000001:00080000:1.0:1789438269.238645:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:1.0:1789438269.238656:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:1.0:1789438269.238668:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:0.0:1789438269.239210:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789438269.239227:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769713280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789438269.239276:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438269.239518:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769713280 00000100:00100000:0.0:1789438269.239526:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769713280 00000100:00100000:0.0:1789438269.239562:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789438269.239570:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7db7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1876361769713280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789438269.239599:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438269.239633:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7db7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1876361769713280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438269.239639:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789438269.239680:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769713280:0@lo:13:osp-pre-0-0.0 00000020:00080000:1.0:1789438269.239774:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1789438269.239783:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1789438269.239968:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789438269.239980:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f47d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769713408:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789438269.240009:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438269.240206:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769713408 00000100:00100000:3.0:1789438269.240210:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769713408 00000100:00100000:3.0:1789438269.240242:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789438269.240249:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769713408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789438269.240532:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789438269.240540:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f47dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769713536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789438269.240566:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438269.240591:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769713536 00000100:00100000:1.0:1789438269.240594:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769713536 00000100:00100000:1.0:1789438269.240616:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789438269.240621:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876361769713536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789438269.240631:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789438269.240661:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876361769713536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438269.240667:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789438269.240698:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f47dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769713536:0@lo:13:osp-pre-1-0.0 00002000:00010000:3.0:1789438269.240861:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789438269.240865:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789438269 00002000:00010000:3.0:1789438269.240867:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789438269.240870:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789438268 -> 1789438269 00002000:00010000:3.0:1789438269.240872:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789438269.240908:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1876361769713408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 660us (898us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789438269.240914:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:0.0:1789438269.241003:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9991f47d8a80/2, rc 0, transno 4294967303 00000100:00100000:0.0:1789438269.241009:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f47d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769713408:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789438269.243225:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438269.243353:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749766912 00000100:00100000:3.0:1789438269.243362:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749766912 00000100:00100000:3.0:1789438269.243419:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 30 00000100:00100000:3.0:1789438269.243430:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa7cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+8:2354:x1876361749766912:12345-192.168.206.9@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789438269.272553:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1789438269.272568:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1789438269.272798:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa7cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+6:2354:x1876361749766912:12345-192.168.206.9@tcp:16:lhsmtool_posix.0 Request processed in 29362us (29575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438269.272817:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 30 00000100:00100000:0.0:1789438269.275976:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438269.276024:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749767168 00000100:00100000:3.0:1789438269.276154:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749767168 00000100:00100000:3.0:1789438269.276219:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 81 00000100:00100000:3.0:1789438269.276230:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+13:10458:x1876361749767168:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789438269.276281:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438269.276307:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925283 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa284 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.276324:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9991c3ac2800) 00010000:00010000:3.0:1789438269.276329:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789438269.276359:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb925298 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.276373:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb925298 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.276382:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb925298 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789438269.276643:0:7624:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000028e5aac1 reply state 00000000582e3b5b transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb925298 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438269.276654:0:7624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789438269.276850:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+14:10458:x1876361749767168:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 621us (880us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1789438269.276861:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 81 00000100:00100000:3.0:1789438269.280240:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00010000:00010000:0.0:1789438269.280323:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb925298 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.280336:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb925298 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.280343:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb925298 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.280350:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55e00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438269.280356:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb925298 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.280365:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb925298 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.280382:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9991c3ac2800) 00010000:00010000:0.0:1789438269.280391:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438269.280397:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb925298 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.280404:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb925298 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438269.282906:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749767296 00000100:00100000:1.0:1789438269.282920:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749767296 00000100:00100000:1.0:1789438269.283027:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 31 00000100:00100000:1.0:1789438269.283053:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1274be99-2d57-4dac-a13e-a89426512ee0+6:2354:x1876361749767296:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789438269.283312:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789438269.283315:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789438269 -> 1789438267 00002000:00010000:1.0:1789438269.283318:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789438266 00002000:00010000:1.0:1789438269.283320:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789438269 -> 1789438267 00002000:00010000:1.0:1789438269.283322:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789438269.283387:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1274be99-2d57-4dac-a13e-a89426512ee0+7:2354:x1876361749767296:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 Request processed in 337us (3157us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789438269.283395:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 31 00000100:00100000:2.0:1789438269.294044:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438269.294084:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749767552 00000100:00100000:2.0:1789438269.294093:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749767552 00000100:00100000:2.0:1789438269.294162:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 82 00000100:00100000:2.0:1789438269.294172:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+13:10458:x1876361749767552:12345-192.168.206.9@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789438269.294236:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb92529f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.294254:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925260 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa276 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.294264:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb92529f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.294314:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925260 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa276 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.294328:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925260 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa276 expref: 13 pid: 5839 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438269.294344:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d04b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876361769713664:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789438269.294428:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c4e5aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789438269.298020:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438269.298061:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749767680 00000100:00100000:1.0:1789438269.298070:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749767680 00010000:00010000:1.0:1789438269.298122:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925260 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa276 expref: 14 pid: 5839 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438269.298154:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 43 00000100:00100000:1.0:1789438269.298164:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+14:2354:x1876361749767680:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789438269.298179:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438269.298186:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925260 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa276 expref: 14 pid: 5839 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.298199:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925260 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa276 expref: 14 pid: 5839 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.298236:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9991c3ac2800) 00010000:00010000:1.0:1789438269.298241:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb92529f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.298250:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb92529f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.298258:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb92529f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.298279:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438269.298327:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+14:2354:x1876361749767680:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 164us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438269.298334:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 43 00010000:00010000:2.0:1789438269.298624:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925260 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa276 expref: 13 pid: 5839 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438269.298640:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d04b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876361769713664:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789438269.298662:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb92529f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.298672:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb92529f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.298688:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb92529f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.298739:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb92529f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.298747:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb92529f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.298753:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb92529f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.298759:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f1600 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438269.298763:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb92529f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.298770:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb92529f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.298780:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9991c3ac2800) 00010000:00010000:2.0:1789438269.298783:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789438269.298787:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb92529f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.298793:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb92529f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438269.298837:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+12:10458:x1876361749767552:12345-192.168.206.9@tcp:55:lhsmtool_posix.0 Request processed in 4666us (4802us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789438269.298845:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 82 00000100:00100000:1.0:1789438269.302791:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00010000:00010000:0.0:1789438269.302816:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438269.302825:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749767808 00000100:00100000:1.0:1789438269.302834:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749767808 00000100:00100000:1.0:1789438269.302885:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 32 00000100:00100000:1.0:1789438269.302897:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1274be99-2d57-4dac-a13e-a89426512ee0+7:2353:x1876361749767808:12345-192.168.206.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789438269.302940:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fa071249/0x7a8dd0fcbb9252a6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.302961:0:8192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ccc3219/0x7a8dd0fcbb925291 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa292 expref: 7 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.302971:0:8192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438269.302980:0:8192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789438269.302995:0:8192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa071249/0x7a8dd0fcbb9252a6 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.303052:0:8192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ccc3219/0x7a8dd0fcbb925291 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa292 expref: 7 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.303071:0:8192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ccc3219/0x7a8dd0fcbb925291 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa292 expref: 7 pid: 8192 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438269.303092:0:8192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f47dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8192:1876361769713792:192.168.206.9@tcp:104: 00000100:00100000:1.0:1789438269.303186:0:8192:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e07f9780 going to sleep for 11 seconds 00000100:00100000:2.0:1789438269.306031:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438269.306147:0:8192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f47dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8192:1876361769713792:192.168.206.9@tcp:104: 00010000:00010000:1.0:1789438269.306175:0:8192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fa071249/0x7a8dd0fcbb9252a6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438269.306205:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749767936 00000100:00100000:3.0:1789438269.306213:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749767936 00010000:00010000:3.0:1789438269.306256:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ccc3219/0x7a8dd0fcbb925291 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa292 expref: 8 pid: 8192 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438269.306294:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 44 00000100:00100000:3.0:1789438269.306303:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+8:2354:x1876361749767936:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789438269.306316:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438269.306336:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ccc3219/0x7a8dd0fcbb925291 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa292 expref: 8 pid: 8192 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.306348:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ccc3219/0x7a8dd0fcbb925291 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa292 expref: 8 pid: 8192 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.306372:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ccc3219/0x7a8dd0fcbb925291 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa292 expref: 8 pid: 8192 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.306385:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789438269.306390:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789438269.306395:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa071249/0x7a8dd0fcbb9252a6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.306404:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa071249/0x7a8dd0fcbb9252a6 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.306444:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789438269.306487:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+7:2354:x1876361749767936:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 185us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438269.306499:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 44 00010000:00010000:2.0:1789438269.306878:0:8192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fa071249/0x7a8dd0fcbb9252a6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.306888:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa071249/0x7a8dd0fcbb9252a6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.306914:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fa071249/0x7a8dd0fcbb9252a6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.306923:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa071249/0x7a8dd0fcbb9252a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.306931:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa071249/0x7a8dd0fcbb9252a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.306938:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dae00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:2.0:1789438269.306942:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa071249/0x7a8dd0fcbb9252a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.306952:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa071249/0x7a8dd0fcbb9252a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.306965:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa071249/0x7a8dd0fcbb9252a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.306973:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa071249/0x7a8dd0fcbb9252a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438269.307169:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1274be99-2d57-4dac-a13e-a89426512ee0+6:2353:x1876361749767808:12345-192.168.206.9@tcp:1:lhsmtool_posix.0 Request processed in 4273us (4385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438269.307178:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 32 00000100:00100000:2.0:1789438269.312376:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438269.312447:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749768192 00000100:00100000:0.0:1789438269.312457:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749768192 00000100:00100000:0.0:1789438269.312514:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 83 00000100:00100000:0.0:1789438269.312524:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+12:10458:x1876361749768192:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789438269.312601:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9252ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.312616:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9252ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.312627:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9252ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.312996:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9252b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.313009:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92526e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa27d expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.313017:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9252b4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.313063:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92526e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa27d expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.313088:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92526e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa27d expref: 13 pid: 5839 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438269.313116:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7db6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876361769713920:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789438269.313193:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f44a7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789438269.325062:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7db6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876361769713920:192.168.206.9@tcp:104: 00010000:00010000:1.0:1789438269.325093:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9252b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438269.330682:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438269.331110:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749768320 00000100:00100000:1.0:1789438269.331122:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749768320 00010000:00010000:1.0:1789438269.331165:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92526e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa27d expref: 14 pid: 5839 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438269.331208:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 45 00000100:00100000:1.0:1789438269.331219:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+14:2356:x1876361749768320:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789438269.331248:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438269.331256:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92526e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa27d expref: 14 pid: 5839 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.331270:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92526e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa27d expref: 14 pid: 5839 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.331292:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92526e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa27d expref: 14 pid: 5839 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.331307:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9991c3ac2800) 00010000:00010000:1.0:1789438269.331312:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9252b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.331322:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9252b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.331330:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9252b4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.331366:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438269.331419:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+13:2356:x1876361749768320:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 201us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438269.331427:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 45 00010000:00010000:3.0:1789438269.331876:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9252b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.331885:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9252b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789438269.332179:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1789438269.332398:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1789438269.332520:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1789438269.332619:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f438c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5840:1876361769714048:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789438269.332686:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438269.332736:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c7d09f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789438269.334884:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769714048 00000100:00100000:1.0:1789438269.334900:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769714048 00000100:00100000:1.0:1789438269.334966:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789438269.334977:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f41ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1876361769714048:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789438269.335115:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f41ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1876361769714048:12345-0@lo:1000:mdt00_002.0 Request processed in 141us (2429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438269.335136:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789438269.335222:0:5840:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1789438269.335229:0:5840:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9991f47d8a80, transno 4294967303 00000100:00100000:3.0:1789438269.335249:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f438c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5840:1876361769714048:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789438269.335890:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1789438269.335975:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f41cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5840:1876361769714176:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789438269.336021:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438269.336045:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d019c180 going to sleep for 11 seconds 00000100:00100000:1.0:1789438269.336350:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769714176 00000100:00100000:1.0:1789438269.336357:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769714176 00000100:00100000:1.0:1789438269.336386:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789438269.336394:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f41cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1876361769714176:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789438269.336561:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f41cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5840:x1876361769714176:12345-0@lo:1000:mdt00_002.0 Request processed in 167us (540us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789438269.336568:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789438269.336843:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f41cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5840:1876361769714176:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1789438269.336879:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9252b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.336890:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9252b4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.336909:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9252b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.336914:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d62600 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438269.336920:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9252b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.336927:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9252b4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.336943:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9991c3ac2800) 00010000:00010000:3.0:1789438269.336946:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789438269.336951:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9252b4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.336957:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9252b4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.336990:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9251e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.336997:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9251e2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.337003:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9251e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.337008:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dba00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438269.337010:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9251e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.337026:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9251e2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.337034:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991c7c83500) 00010000:00010000:3.0:1789438269.337036:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789438269.337039:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9251e2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.337045:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9251e2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.337065:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9252bb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.337077:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9251fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa261 expref: 16 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.337086:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9252bb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.337129:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9251fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa261 expref: 16 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.337143:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9251fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa261 expref: 16 pid: 7624 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438269.337156:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f41ced80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876361769714304:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789438269.337218:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d019c180 going to sleep for 11 seconds 00000100:00100000:2.0:1789438269.343232:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438269.343320:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f41ced80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876361769714304:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789438269.343359:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9252bb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438269.344274:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749768448 00000100:00100000:1.0:1789438269.344284:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749768448 00010000:00010000:1.0:1789438269.344325:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9251fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa261 expref: 17 pid: 7624 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438269.344373:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 46 00000100:00100000:1.0:1789438269.344383:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+17:2353:x1876361749768448:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789438269.344400:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438269.344407:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9251fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa261 expref: 17 pid: 7624 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.344586:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9251fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa261 expref: 17 pid: 7624 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.344610:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9251fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa261 expref: 17 pid: 7624 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.344624:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991c7c83500) 00010000:00010000:1.0:1789438269.344636:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9252bb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.344646:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9252bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.344653:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9252bb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.345034:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438269.345113:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+16:2353:x1876361749768448:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 721us (1880us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438269.345122:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 46 00010000:00010000:3.0:1789438269.348934:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9252bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.348953:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9252bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.348969:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9252bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.348976:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9252bb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.348985:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9252bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.348991:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438269.348995:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9252bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.349003:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9252bb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.349021:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991c7c83500) 00010000:00010000:3.0:1789438269.349025:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789438269.349030:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9252bb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.349305:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9252bb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.349328:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9252ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.349334:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9252ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.349340:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9252ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.349344:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d62c00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438269.349348:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9252ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.349353:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9252ad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.349361:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991c7c83500) 00010000:00010000:3.0:1789438269.349363:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789438269.349366:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9252ad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.349372:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9252ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438269.349756:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+15:10458:x1876361749768192:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 37228us (37384us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1789438269.349769:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 83 00000020:00080000:2.0:1789438269.349775:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789438269.350093:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789438269.350098:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789438269.350207:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789438269.350214:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789438269.358701:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438269.359194:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749768704 00000100:00100000:1.0:1789438269.359204:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749768704 00000100:00100000:1.0:1789438269.359255:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 20 00000100:00100000:1.0:1789438269.359266:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f41ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+15:10458:x1876361749768704:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789438269.359969:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789438269.360073:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1789438269.360130:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9252c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.360147:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9252c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.360159:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9252c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.360168:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9252c2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.360184:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9252c2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.360191:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9252c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.360212:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789438269.360302:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f41ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+17:10458:x1876361749768704:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 Request processed in 1035us (1606us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1789438269.360310:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 20 00000020:00080000:1.0:1789438269.360316:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789438269.360493:0:11648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789438269.360500:0:11648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9252c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.360507:0:11648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9da600 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:2.0:1789438269.360511:0:11648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9252c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.360519:0:11648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9252c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.360531:0:11648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9991c7c83f00) 00010000:00010000:2.0:1789438269.360534:0:11648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789438269.360538:0:11648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9252c2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.360544:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9252c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.360569:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438269.360570:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438269.360572:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789438269.416001:0:11981:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789438269.416009:0:11981:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789438269.416059:0:11981:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789438269.416066:0:11981:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789438269.536771:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438269.538553:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749768960 00000100:00100000:2.0:1789438269.538567:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749768960 00000100:00100000:2.0:1789438269.538636:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 84 00000100:00100000:2.0:1789438269.538648:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+17:10468:x1876361749768960:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789438269.538675:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438269.538696:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb9252c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa299 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.538823:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb9252d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.538839:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb9252d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.538851:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb9252d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438269.538863:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789438269.538984:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb9252c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa299 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.539002:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb9252d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa299 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.539010:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:2.0:1789438269.539020:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789438269.539024:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f1600, rc 0) 00000100:00100000:2.0:1789438269.539099:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+19:10468:x1876361749768960:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 454us (2333us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1789438269.539119:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 84 00000100:00100000:2.0:1789438269.543294:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438269.543934:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749769088 00000100:00100000:3.0:1789438269.543952:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749769088 00000100:00100000:3.0:1789438269.544026:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 85 00000100:00100000:3.0:1789438269.544049:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+19:10468:x1876361749769088:12345-192.168.206.9@tcp:34:lfs.0 00010000:00010000:3.0:1789438269.544131:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9252de lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.544148:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9252de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.544160:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9252de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.544176:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9252e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.544184:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9252e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.544191:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9252e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.545569:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb9252ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.545588:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb9252ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.545599:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb9252ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789438269.545648:0:7624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb9252ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.545675:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9252de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.545682:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9252de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.545689:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9252de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.545694:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438269.545699:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9252de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.546513:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9252de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.546528:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:3.0:1789438269.546531:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789438269.546537:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9252de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.546543:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9252de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.546559:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9252e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.546565:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9252e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.546571:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9252e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.546584:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54c00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438269.546588:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9252e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.546594:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9252e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.546605:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9991d192c300) 00010000:00010000:3.0:1789438269.546607:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789438269.546611:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9252e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.546617:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9252e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.546636:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb9252ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.546642:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb9252ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.546648:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb9252ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.546653:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438269.546656:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb9252ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.546663:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb9252ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.546682:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d192cd00) 00010000:00010000:3.0:1789438269.546684:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789438269.546687:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb9252ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.546693:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb9252ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438269.546815:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+19:10468:x1876361749769088:12345-192.168.206.9@tcp:34:lfs.0 Request processed in 2764us (3526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438269.546825:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 85 00000100:00100000:2.0:1789438269.595827:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438269.595936:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749769344 00000100:00100000:1.0:1789438269.595948:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749769344 00000100:00100000:1.0:1789438269.596011:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 86 00000100:00100000:1.0:1789438269.596022:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+19:10471:x1876361749769344:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438269.596042:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438269.596068:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9252f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa2a0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.596156:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9252fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.596171:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9252fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.596183:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9252fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.596217:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb925301 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.596226:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb925301 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.596233:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb925301 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.597314:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925308 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.597329:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.597338:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438269.597349:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789438269.597690:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9252fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.597700:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9252fa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.598948:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9252fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.598955:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dba00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438269.598960:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9252fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.598969:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9252fa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.599005:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:2.0:1789438269.599008:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438269.599013:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9252fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.599020:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9252fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.599038:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb925301 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.599045:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb925301 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.599051:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb925301 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.599056:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9db400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438269.599059:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb925301 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.599065:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb925301 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.599072:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9991c7c83700) 00010000:00010000:2.0:1789438269.599075:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438269.599078:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb925301 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.599084:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb925301 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.599277:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9252f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2a0 expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.599293:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925308 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2a0 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.599302:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872900) 00010000:00010000:2.0:1789438269.599304:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789438269.599306:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f1800, rc 0) 00000100:00100000:2.0:1789438269.599487:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+21:10471:x1876361749769344:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 3465us (3667us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1789438269.599497:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 86 00000100:00100000:3.0:1789438269.608062:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438269.608286:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749769472 00000100:00100000:2.0:1789438269.608296:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749769472 00000100:00100000:2.0:1789438269.608359:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 87 00000100:00100000:2.0:1789438269.608371:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f41cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+21:10471:x1876361749769472:12345-192.168.206.9@tcp:54:lfs.0 00010000:00010000:2.0:1789438269.608526:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925316 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.608545:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925316 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.608556:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925316 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.608582:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925316 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.608605:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925316 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.608612:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925316 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.608618:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0600 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438269.608623:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925316 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.608630:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925316 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.608642:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872900) 00010000:00010000:2.0:1789438269.608645:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789438269.608649:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925316 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.608655:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925316 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438269.608961:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f41cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+21:10471:x1876361749769472:12345-192.168.206.9@tcp:54:lfs.0 Request processed in 590us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438269.608970:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 87 00000100:00100000:0.0:1789438269.613851:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438269.614041:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749769728 00000100:00100000:1.0:1789438269.614051:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749769728 00000100:00100000:1.0:1789438269.614116:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 21 00000100:00100000:1.0:1789438269.614127:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d21b8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+21:10471:x1876361749769728:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:1.0:1789438269.614968:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d21b8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+22:10471:x1876361749769728:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 837us (1120us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1789438269.614978:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 21 00000100:00100000:0.0:1789438269.663913:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438269.665001:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749769984 00000100:00100000:3.0:1789438269.665016:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749769984 00000100:00100000:3.0:1789438269.665877:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 88 00000100:00100000:3.0:1789438269.665890:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+22:10000:x1876361749769984:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:3.0:1789438269.666623:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438269.666645:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54200/0x7a8dd0fcbb92531d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa2a7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.666768:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb925324 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.666784:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925308 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2a0 expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.666793:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb925324 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.666849:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925308 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2a0 expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.666865:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925308 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2a0 expref: 23 pid: 5838 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438269.666880:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f41cd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876361769714432:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789438269.666992:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c7e889c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438269.681685:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438269.681844:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f41cd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876361769714432:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789438269.681877:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb925324 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438269.681959:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749770112 00000100:00100000:1.0:1789438269.681968:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749770112 00010000:00010000:1.0:1789438269.682007:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925308 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2a0 expref: 24 pid: 5838 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438269.682182:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 47 00000100:00100000:1.0:1789438269.682194:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f41cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+24:2354:x1876361749770112:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789438269.682228:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438269.682237:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925308 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2a0 expref: 24 pid: 5838 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.682270:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925308 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2a0 expref: 24 pid: 5838 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.682291:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925308 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2a0 expref: 24 pid: 5838 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.682308:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872900) 00010000:00010000:1.0:1789438269.682313:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb925324 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.682323:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb925324 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.682330:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb925324 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.682362:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789438269.682442:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb925324 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.682451:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb925324 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789438269.682469:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789438269.682622:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54200/0x7a8dd0fcbb92531d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2a7 expref: 25 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.682639:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb925324 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2a7 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.682647:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872900) 00010000:00010000:3.0:1789438269.682650:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789438269.682652:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a55400, rc 0) 00000100:00100000:1.0:1789438269.682765:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f41cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+24:2354:x1876361749770112:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 572us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438269.682774:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 47 00000100:00100000:3.0:1789438269.683447:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+23:10000:x1876361749769984:12345-192.168.206.9@tcp:101:bash.0 Request processed in 17556us (19539us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1789438269.683470:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 88 00000100:00100000:0.0:1789438269.692396:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438269.692482:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749770368 00000100:00100000:3.0:1789438269.692493:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749770368 00000100:00100000:3.0:1789438269.692564:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 89 00000100:00100000:3.0:1789438269.692575:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+23:10000:x1876361749770368:12345-192.168.206.9@tcp:36:bash.0 00010000:00010000:2.0:1789438269.693690:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925332 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.693744:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.693758:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789438269.693893:0:7624:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1789438269.693931:0:7624:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e966768 reply state 000000004cefa2f6 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438269.693942:0:7624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789438269.693994:0:7624:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1789438269.694370:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+27:10000:x1876361749770368:12345-192.168.206.9@tcp:36:bash.0 Request processed in 1794us (1980us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1789438269.694379:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 89 00000020:00080000:2.0:1789438269.694384:0:7624:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789438269.696800:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00010000:00010000:1.0:1789438269.696894:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.696906:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925332 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.696914:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925332 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.696940:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0600 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438269.696946:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925332 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.696955:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925332 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.696971:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872900) 00010000:00010000:1.0:1789438269.696974:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438269.696980:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925332 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.696986:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925332 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438269.697275:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749770496 00000100:00100000:2.0:1789438269.697285:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749770496 00000100:00100000:2.0:1789438269.697337:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 90 00000100:00100000:2.0:1789438269.697348:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+26:10000:x1876361749770496:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:2.0:1789438269.697371:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438269.697388:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925339 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa2ae expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.697447:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925339 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2ae expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.697461:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925339 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2ae expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.697495:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872900) 00010000:00010000:2.0:1789438269.697498:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789438269.697501:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f0e00, rc 0) 00000100:00100000:2.0:1789438269.697574:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+27:10000:x1876361749770496:12345-192.168.206.9@tcp:101:bash.0 Request processed in 228us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438269.697581:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 90 00000100:00100000:2.0:1789438269.710578:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438269.710675:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749770624 00000100:00100000:3.0:1789438269.710696:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749770624 00000100:00100000:3.0:1789438269.710805:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 33 00000100:00100000:3.0:1789438269.710816:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+6:10000:x1876361749770624:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:3.0:1789438269.710844:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438269.710866:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925340 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa2b5 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789438269.710893:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa8a93b, atime: 0x6aa8a93a, ctime: 0x6aa8a93b, blocks: 0xb 00010000:00010000:3.0:1789438269.710916:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=321s v=(0 0) 00010000:00010000:3.0:1789438269.710922:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438269.710930:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925340 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2b5 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.710947:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925340 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2b5 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438269.710960:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a54200, rc 0) 00000100:00100000:3.0:1789438269.711025:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+7:10000:x1876361749770624:12345-192.168.206.9@tcp:101:bash.0 Request processed in 211us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438269.711612:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 33 00000100:00100000:2.0:1789438269.714545:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438269.720152:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749770752 00000100:00100000:0.0:1789438269.720168:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749770752 00002000:00010000:1.0:1789438269.722016:0:6685:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1789438269.722026:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9991d04b1c00 with x1876361749770752 ext(0->18446744073709551615) 00002000:00010000:1.0:1789438269.722038:0:6685:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9991d04b1c00. 00000100:00100000:1.0:1789438269.722085:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 1 00000100:00100000:1.0:1789438269.722097:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1274be99-2d57-4dac-a13e-a89426512ee0+7:2353:x1876361749770752:12345-192.168.206.9@tcp:10:bash.0 00002000:00010000:1.0:1789438269.722670:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789438269.722674:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789438267 -> 1789438269 00002000:00010000:1.0:1789438269.722677:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789438266 -> 1789438266 00002000:00010000:1.0:1789438269.722900:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789438267 -> 1789438269 00002000:00010000:1.0:1789438269.722903:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789438269.722982:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1274be99-2d57-4dac-a13e-a89426512ee0+8:2353:x1876361749770752:12345-192.168.206.9@tcp:10:bash.0 Request processed in 885us (8442us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789438269.723001:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 1 00002000:00010000:1.0:1789438269.723006:0:6685:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1789438269.723009:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9991d04b1c00 with x1876361749770752 ext(0->18446744073709551615) 00002000:00010000:1.0:1789438269.723016:0:6685:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9991d04b1c00. 00000100:00100000:0.0:1789438269.839271:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438269.839344:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749770880 00000100:00100000:2.0:1789438269.839356:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749770880 00000100:00100000:2.0:1789438269.839425:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 91 00000100:00100000:2.0:1789438269.839436:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+27:10484:x1876361749770880:12345-192.168.206.9@tcp:34:lfs.0 00010000:00010000:2.0:1789438269.839504:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb925347 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.839521:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb925347 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.839535:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb925347 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.839551:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb92534e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.839558:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb92534e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.839565:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb92534e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.839870:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb925355 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.839880:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb925355 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.839888:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb925355 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789438269.839928:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb925355 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.839938:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb925347 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.839945:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb925347 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.839951:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb925347 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.839969:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438269.839974:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb925347 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.839989:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb925347 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.840001:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:2.0:1789438269.840004:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438269.840009:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb925347 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.840023:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb925347 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.840035:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb92534e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.840042:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb92534e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.840048:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb92534e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.840053:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438269.840056:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb92534e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.840062:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb92534e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.840070:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9991d5872600) 00010000:00010000:2.0:1789438269.840072:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438269.840075:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb92534e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.840081:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb92534e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.840096:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb925355 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.840114:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb925355 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.840126:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb925355 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.840131:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0a00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438269.840134:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb925355 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.840140:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb925355 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.840147:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872900) 00010000:00010000:2.0:1789438269.840150:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438269.840153:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb925355 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.840159:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb925355 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438269.840257:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+27:10484:x1876361749770880:12345-192.168.206.9@tcp:34:lfs.0 Request processed in 822us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438269.840265:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 91 00000100:00100000:2.0:1789438269.946766:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438269.950210:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749771136 00000100:00100000:0.0:1789438269.950228:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749771136 00000100:00100000:0.0:1789438269.950305:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 92 00000100:00100000:0.0:1789438269.950316:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+27:10488:x1876361749771136:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:0.0:1789438269.950341:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438269.950363:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb92535c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa2bc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.950439:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925363 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.950476:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925363 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.950490:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925363 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.950508:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92536a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.950516:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92536a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.950523:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92536a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.950826:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925371 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.950837:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925371 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.950844:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925371 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438269.950854:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789438269.950951:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925363 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.950959:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925363 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.950966:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925363 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.950996:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63a00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438269.951001:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925363 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.951009:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925363 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.951020:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:0.0:1789438269.951022:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438269.951027:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925363 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.951034:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925363 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.951048:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92536a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.951054:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92536a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.951060:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92536a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.951065:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63e00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438269.951067:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92536a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.951073:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92536a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.951091:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9991c3ac2200) 00010000:00010000:0.0:1789438269.951093:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438269.951097:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92536a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.951114:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92536a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.951158:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb92535c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2bc expref: 30 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.951174:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925371 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2bc expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.951180:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872900) 00010000:00010000:0.0:1789438269.951183:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789438269.951185:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63200, rc 0) 00000100:00100000:0.0:1789438269.951261:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+29:10488:x1876361749771136:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 945us (4550us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1789438269.951269:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 92 00000100:00100000:2.0:1789438269.958345:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438269.958534:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749771264 00000100:00100000:0.0:1789438269.958546:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749771264 00000100:00100000:0.0:1789438269.958609:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 93 00000100:00100000:0.0:1789438269.958621:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+29:10488:x1876361749771264:12345-192.168.206.9@tcp:54:lfs.0 00010000:00010000:0.0:1789438269.958691:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb92537f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.958729:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb925324 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2a7 expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.958753:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb92537f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.958792:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb925324 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2a7 expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438269.958805:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb925324 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2a7 expref: 29 pid: 5839 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438269.958820:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7db6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876361769714560:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789438269.958915:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f44a7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789438269.964871:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7db6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876361769714560:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438269.964905:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb92537f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438269.966436:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438269.966536:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749771520 00000100:00100000:0.0:1789438269.966546:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749771520 00000100:00100000:0.0:1789438269.966612:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 22 00000100:00100000:0.0:1789438269.966623:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+30:5593:x1876361749771520:12345-192.168.206.9@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789438269.967000:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+31:5593:x1876361749771520:12345-192.168.206.9@tcp:35:ldlm_bl.0 Request processed in 378us (572us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1789438269.967008:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 22 00000100:00100000:2.0:1789438269.978515:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438269.978651:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749771648 00000100:00100000:1.0:1789438269.978663:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749771648 00010000:00010000:1.0:1789438269.978730:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb925324 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2a7 expref: 31 pid: 5839 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438269.978780:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 48 00000100:00100000:1.0:1789438269.978791:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+31:2354:x1876361749771648:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789438269.978806:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438269.978813:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb925324 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2a7 expref: 31 pid: 5839 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.978827:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb925324 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2a7 expref: 31 pid: 5839 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.978849:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb925324 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2a7 expref: 31 pid: 5839 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.978866:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872900) 00010000:00010000:1.0:1789438269.978872:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb92537f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.978882:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb92537f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.978909:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb92537f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438269.978945:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438269.979010:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+30:2354:x1876361749771648:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 221us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438269.979018:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 48 00010000:00010000:2.0:1789438269.979324:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb92537f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.979333:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb92537f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.979383:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb92537f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.979391:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb92537f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.979399:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb92537f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.979405:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438269.979410:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb92537f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.979418:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb92537f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.979428:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872900) 00010000:00010000:2.0:1789438269.979431:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789438269.979435:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb92537f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438269.979443:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb92537f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438269.979504:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+29:10488:x1876361749771264:12345-192.168.206.9@tcp:54:lfs.0 Request processed in 20870us (21155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438269.979513:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 93 00000100:00100000:2.0:1789438269.989539:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438269.989772:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749771904 00000100:00100000:0.0:1789438269.989782:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749771904 00000100:00100000:0.0:1789438269.989965:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 23 00000100:00100000:0.0:1789438269.990152:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+29:10488:x1876361749771904:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:0.0:1789438269.990620:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+30:10488:x1876361749771904:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 643us (1089us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1789438269.990628:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 23 00000100:00100000:0.0:1789438270.078476:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438270.078745:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749772160 00000100:00100000:3.0:1789438270.078755:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749772160 00000100:00100000:3.0:1789438270.078820:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 94 00000100:00100000:3.0:1789438270.078832:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+30:10499:x1876361749772160:12345-192.168.206.9@tcp:101:cat.0 00010000:00010000:3.0:1789438270.078855:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438270.078875:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb925386 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa2c3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.078947:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92538d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.078962:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92538d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.078974:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92538d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.079004:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb925394 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.079011:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb925394 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.079017:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb925394 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.079508:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92539b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.079530:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92539b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.079538:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92539b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789438270.079548:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1789438270.079640:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92538d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.079647:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92538d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.079654:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92538d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.079660:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438270.079664:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92538d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.079671:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92538d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.079682:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:3.0:1789438270.079685:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789438270.079689:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92538d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.079695:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92538d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.079765:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb925394 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.079777:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb925394 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.079783:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb925394 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.079788:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438270.079791:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb925394 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.079797:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb925394 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.079804:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9991d192c700) 00010000:00010000:3.0:1789438270.079807:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789438270.079809:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb925394 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.079815:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb925394 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.079858:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb925386 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2c3 expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.079874:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92539b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2c3 expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.079881:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872900) 00010000:00010000:3.0:1789438270.079884:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789438270.079893:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a55a00, rc 0) 00000100:00100000:3.0:1789438270.079955:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+32:10499:x1876361749772160:12345-192.168.206.9@tcp:101:cat.0 Request processed in 1125us (1487us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1789438270.079963:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 94 00000100:00080000:2.0:1789438270.080088:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789438270.093664:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438270.094249:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749772416 00000100:00100000:1.0:1789438270.094262:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749772416 00000100:00100000:1.0:1789438270.094327:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 24 00000100:00100000:1.0:1789438270.094338:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+32:10499:x1876361749772416:12345-192.168.206.9@tcp:35:cat.0 00000100:00100000:1.0:1789438270.094587:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+33:10499:x1876361749772416:12345-192.168.206.9@tcp:35:cat.0 Request processed in 249us (930us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1789438270.094595:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 24 00000100:00100000:2.0:1789438270.119366:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438270.119463:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749772672 00000100:00100000:0.0:1789438270.119473:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749772672 00000100:00100000:0.0:1789438270.119534:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 95 00000100:00100000:0.0:1789438270.119545:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+33:10500:x1876361749772672:12345-192.168.206.9@tcp:36:rm.0 00010000:00010000:0.0:1789438270.119600:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789438270.119629:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92539b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2c3 expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.119651:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925371 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2bc expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.119664:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925339 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2ae expref: 31 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.119673:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991d5872900) 00010000:00010000:0.0:1789438270.119684:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789438270.119740:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb9253a9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.119753:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb9253a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.119763:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb9253a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.119796:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb9253b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.119804:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb9253b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.119811:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb9253b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.120285:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9253b7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.120295:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9253b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.120302:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9253b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789438270.121609:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1789438270.121622:0:7624:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 322386913841ns, next at 323386911211ns, rc = 0 00010000:00010000:0.0:1789438270.121693:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9253be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.122379:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9253be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.122394:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9253be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.122403:0:7624:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9253be lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.122427:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9253be lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.122432:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9253be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.122515:0:7624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789438270.122541:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9253b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.122547:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9253b7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.122553:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9253b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.122558:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438270.122563:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9253b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.122570:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9253b7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.122582:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991c3ac2a00) 00010000:00010000:0.0:1789438270.122586:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789438270.122590:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9253b7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.122597:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9253b7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.122620:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb9253a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.122632:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb9253a9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.122638:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb9253a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.122643:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63e00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438270.122646:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb9253a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.122651:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb9253a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.122660:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:0.0:1789438270.122662:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438270.122665:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb9253a9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.122670:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb9253a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789438270.122680:0:7624:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006827ef3d reply state 000000005289c3f5 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb9253b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438270.122688:0:7624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789438270.122820:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+32:10500:x1876361749772672:12345-192.168.206.9@tcp:36:rm.0 Request processed in 3274us (3459us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1789438270.122829:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 95 00010000:00010000:1.0:1789438270.125351:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb9253b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.125367:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb9253b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.125375:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb9253b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.125381:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63a00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438270.125385:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb9253b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.125393:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb9253b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.125420:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9991c3ac2200) 00010000:00010000:1.0:1789438270.125422:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438270.125427:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb9253b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.125433:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb9253b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.125572:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789438270.125580:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9253be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.125586:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63400 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:2.0:1789438270.125590:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9253be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.125596:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9253be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.125606:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9991c3ac2a00) 00010000:00010000:2.0:1789438270.125609:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789438270.125612:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9253be lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.125618:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9253be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.125632:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438270.125634:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438270.125636:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438270.188545:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438270.190200:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749772928 00000100:00100000:3.0:1789438270.190229:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749772928 00000100:00100000:3.0:1789438270.190300:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 96 00000100:00100000:3.0:1789438270.190311:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+31:10506:x1876361749772928:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:3.0:1789438270.190333:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438270.190353:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9253c5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa2ca expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.190462:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9253cc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.190476:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9253cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.190487:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9253cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.190501:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9253d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.190507:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9253d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.190513:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9253d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789438270.191740:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1789438270.194171:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb9253da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.194193:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb9253da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.194207:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb9253da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.195155:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9253cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.195166:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9253cc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.195173:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9253cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.195180:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438270.195185:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9253cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.195193:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9253cc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.195206:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:3.0:1789438270.195209:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789438270.195214:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9253cc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.196106:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9253cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789438270.196152:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc9580c2 reply state 00000000e330481a transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9253d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438270.196161:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789438270.196205:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9253c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2ca expref: 34 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.196690:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb9253da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2ca expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.196702:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991d192c000) 00010000:00010000:3.0:1789438270.196705:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789438270.196818:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a54400, rc 0) 00000100:00100000:3.0:1789438270.196906:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+34:10506:x1876361749772928:12345-192.168.206.9@tcp:101:bash.0 Request processed in 6595us (8367us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1789438270.196915:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 96 00010000:00010000:1.0:1789438270.202860:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9253d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.202878:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9253d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.202886:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9253d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.202892:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438270.202897:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9253d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.202905:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9253d3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.202935:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9991d192c700) 00010000:00010000:1.0:1789438270.202939:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438270.202945:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9253d3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.203137:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb9253d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438270.205419:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438270.206361:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749773056 00000100:00100000:1.0:1789438270.206374:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749773056 00000100:00100000:1.0:1789438270.206475:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 34 00000100:00100000:1.0:1789438270.206489:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+5:2353:x1876361749773056:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:1.0:1789438270.206507:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438270.206527:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb9253e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa2d1 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789438270.206554:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438270.206575:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=322s v=(0 0) 00010000:00010000:1.0:1789438270.206580:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438270.206588:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb9253e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2d1 expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.206606:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb9253e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2d1 expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.206618:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9dae00, rc 0) 00000100:00100000:1.0:1789438270.206682:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+6:2353:x1876361749773056:12345-192.168.206.9@tcp:101:bash.0 Request processed in 195us (1271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438270.206688:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 34 00000100:00080000:2.0:1789438270.206831:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789438270.221174:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438270.221266:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749773184 00000100:00100000:1.0:1789438270.221278:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749773184 00000100:00100000:1.0:1789438270.221337:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 35 00000100:00100000:1.0:1789438270.221348:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f400a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1274be99-2d57-4dac-a13e-a89426512ee0+6:10506:x1876361749773184:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:1.0:1789438270.221383:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438270.221405:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002af35e79/0x7a8dd0fcbb9253ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa2d8 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.221441:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb9253e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2d1 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.221450:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438270.221454:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438270.221459:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002af35e79/0x7a8dd0fcbb9253ef lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2d8 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.221495:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb9253e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2d1 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.221509:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb9253e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2d1 expref: 7 pid: 6680 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438270.221525:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f47d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1876361769714688:192.168.206.9@tcp:104: 00000100:00100000:1.0:1789438270.221621:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e07f9300 going to sleep for 11 seconds 00000100:00100000:2.0:1789438270.229689:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f47d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1876361769714688:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789438270.229772:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002af35e79/0x7a8dd0fcbb9253ef lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2d8 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.229827:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9da000, rc 0) 00000100:00100000:2.0:1789438270.229894:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f400a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1274be99-2d57-4dac-a13e-a89426512ee0+7:10506:x1876361749773184:12345-192.168.206.9@tcp:101:bash.0 Request processed in 8547us (8727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438270.229903:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 35 00000100:00100000:2.0:1789438270.235618:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438270.235750:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749773312 00000100:00100000:0.0:1789438270.235761:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749773312 00010000:00010000:0.0:1789438270.235828:0:8438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb9253e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2d1 expref: 7 pid: 6680 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438270.235875:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 49 00000100:00100000:0.0:1789438270.235886:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d055d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1274be99-2d57-4dac-a13e-a89426512ee0+7:2354:x1876361749773312:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789438270.235903:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438270.235928:0:8438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb9253e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2d1 expref: 7 pid: 6680 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.235943:0:8438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb9253e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2d1 expref: 7 pid: 6680 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.235967:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb9253e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2d1 expref: 7 pid: 6680 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.235997:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789438270.236002:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789438270.236011:0:8438:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002af35e79/0x7a8dd0fcbb9253ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2d8 expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.236023:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002af35e79/0x7a8dd0fcbb9253ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2d8 expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.236427:0:8438:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002af35e79/0x7a8dd0fcbb9253ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2d8 expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438270.236458:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7db6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8438:1876361769714816:192.168.206.9@tcp:105: 00000100:00100000:0.0:1789438270.236544:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f44a7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789438270.241514:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438270.241619:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7db6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8438:1876361769714816:192.168.206.9@tcp:105: 00010000:00010000:0.0:1789438270.241645:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438270.241739:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d055d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1274be99-2d57-4dac-a13e-a89426512ee0+6:2354:x1876361749773312:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 5819us (6096us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438270.241753:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 49 00000100:00100000:1.0:1789438270.242539:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749773568 00000100:00100000:1.0:1789438270.242548:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749773568 00000100:00100000:1.0:1789438270.242601:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 25 00000100:00100000:1.0:1789438270.242612:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+33:10506:x1876361749773568:12345-192.168.206.9@tcp:35:bash.0 00000100:00100000:1.0:1789438270.243362:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+34:10506:x1876361749773568:12345-192.168.206.9@tcp:35:bash.0 Request processed in 749us (1855us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1789438270.243384:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 25 00010000:00010000:1.0:1789438270.332953:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789438270.391066:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789438270.391076:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789438270.391124:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789438270.391131:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789438270.469858:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438270.469977:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749773696 00000100:00100000:1.0:1789438270.469998:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749773696 00000100:00100000:1.0:1789438270.470060:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 97 00000100:00100000:1.0:1789438270.470072:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+34:10522:x1876361749773696:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438270.470104:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438270.470127:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb9253f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa2df expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.470193:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9253fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.470209:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9253fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.470222:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9253fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438270.470257:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789438270.470260:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789438270.470279:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9253fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.470303:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb9253f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2df expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.470322:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9253fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2df expref: 35 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.470351:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:1.0:1789438270.470354:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789438270.470358:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9dbe00, rc 0) 00000100:00100000:1.0:1789438270.470431:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+35:10522:x1876361749773696:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 361us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438270.470439:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 97 00000100:00100000:2.0:1789438270.475353:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438270.475501:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749773952 00000100:00100000:0.0:1789438270.475511:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749773952 00000100:00100000:0.0:1789438270.475578:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 98 00000100:00100000:0.0:1789438270.475589:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+35:10522:x1876361749773952:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:0.0:1789438270.475610:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438270.475630:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925404 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa2e6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.475761:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92540b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.475775:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92540b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.475787:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92540b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438270.475810:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789438270.475936:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925404 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2e6 expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.475957:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92540b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2e6 expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.475965:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991d192c000) 00010000:00010000:0.0:1789438270.475967:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789438270.475971:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63000, rc 0) 00000100:00100000:0.0:1789438270.476045:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+37:10522:x1876361749773952:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 457us (700us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1789438270.476052:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 98 00000100:00100000:2.0:1789438270.480437:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438270.480615:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749774080 00000100:00100000:1.0:1789438270.480625:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749774080 00000100:00100000:2.0:1789438270.481620:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438270.481758:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749774336 00000100:00100000:0.0:1789438270.481766:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749774336 00000100:00100000:0.0:1789438270.481807:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 99 00000100:00100000:0.0:1789438270.481818:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+38:10522:x1876361749774336:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:0.0:1789438270.481840:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438270.481860:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925419 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa2ed expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.481963:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb925420 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.481979:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb925420 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.482020:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb925420 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438270.482045:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789438270.482180:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925419 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2ed expref: 41 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.482215:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb925420 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2ed expref: 40 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.482224:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991d192c000) 00010000:00010000:0.0:1789438270.482227:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789438270.482231:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d62000, rc 0) 00000100:00100000:0.0:1789438270.482283:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+40:10522:x1876361749774336:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 467us (669us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1789438270.482290:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 99 00000100:00100000:1.0:1789438270.482391:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 6 00000100:00100000:1.0:1789438270.482402:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+39:2354:x1876361749774080:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789438270.482413:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438270.482428:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92540b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2e6 expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.482439:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991d192c000) 00010000:00010000:1.0:1789438270.482442:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438270.482462:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+38:2354:x1876361749774080:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 65us (2036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438270.482469:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 6 00000100:00100000:2.0:1789438270.486806:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438270.486941:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749774464 00000100:00100000:1.0:1789438270.486961:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749774464 00000100:00100000:1.0:1789438270.487022:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 36 00000100:00100000:1.0:1789438270.487235:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+6:2355:x1876361749774464:12345-192.168.206.9@tcp:1:lfs.0 00010000:00010000:1.0:1789438270.487285:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb92542e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.487324:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002af35e79/0x7a8dd0fcbb9253ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2d8 expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.487332:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438270.487337:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789438270.487342:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb92542e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.487450:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002af35e79/0x7a8dd0fcbb9253ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2d8 expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.487465:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002af35e79/0x7a8dd0fcbb9253ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2d8 expref: 6 pid: 6681 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438270.487481:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f47dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876361769714944:192.168.206.9@tcp:104: 00000100:00100000:1.0:1789438270.487568:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e07f9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789438270.492112:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438270.492209:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f47dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876361769714944:192.168.206.9@tcp:104: 00010000:00010000:1.0:1789438270.492239:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb92542e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438270.492301:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749774592 00000100:00100000:0.0:1789438270.492309:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749774592 00002000:00100000:0.0:1789438270.492350:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9991d04b1f80 x1876361749774592/t0(0) o4->1274be99-2d57-4dac-a13e-a89426512ee0@192.168.206.9@tcp:701/0 lens 504/0 e 0 to 0 dl 1789438281 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789438270.492371:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9991d04b1f80 with x1876361749774592 ext(0->8) 00010000:00010000:0.0:1789438270.492378:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002af35e79/0x7a8dd0fcbb9253ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2d8 expref: 7 pid: 6681 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.492392:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002af35e79/0x7a8dd0fcbb9253ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2d8 expref: 7 pid: 6681 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789438270.492415:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9991d04b1f80 00000100:00100000:0.0:1789438270.492452:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 1 00000100:00100000:0.0:1789438270.492461:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1274be99-2d57-4dac-a13e-a89426512ee0+7:2354:x1876361749774592:12345-192.168.206.9@tcp:4:lfs.0 00000100:00100000:0.0:1789438270.492921:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1274be99-2d57-4dac-a13e-a89426512ee0+9:2354:x1876361749774592:12345-192.168.206.9@tcp:4:lfs.0 Request processed in 460us (826us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789438270.492929:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 1 00002000:00100000:0.0:1789438270.492936:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9991d04b1f80 x1876361749774592/t4294967302(0) o4->1274be99-2d57-4dac-a13e-a89426512ee0@192.168.206.9@tcp:701/0 lens 504/448 e 0 to 0 dl 1789438281 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789438270.492944:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9991d04b1f80 with x1876361749774592 ext(0->8) 00010000:00010000:0.0:1789438270.492949:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002af35e79/0x7a8dd0fcbb9253ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2d8 expref: 9 pid: 6681 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.492961:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002af35e79/0x7a8dd0fcbb9253ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2d8 expref: 9 pid: 6681 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789438270.492968:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9991d04b1f80 00000100:00100000:2.0:1789438270.504852:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438270.513329:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749774720 00000100:00100000:1.0:1789438270.513346:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749774720 00010000:00010000:1.0:1789438270.514174:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002af35e79/0x7a8dd0fcbb9253ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2d8 expref: 9 pid: 6681 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438270.514382:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 50 00000100:00100000:1.0:1789438270.514393:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff9e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+9:2356:x1876361749774720:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789438270.514410:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789438270.514430:0:5822:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789438270.514433:0:5822:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789438270 00002000:00010000:1.0:1789438270.514435:0:5822:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789438270 00002000:00010000:1.0:1789438270.514437:0:5822:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789438270 00010000:00010000:1.0:1789438270.514444:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002af35e79/0x7a8dd0fcbb9253ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2d8 expref: 9 pid: 6681 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.514458:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002af35e79/0x7a8dd0fcbb9253ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2d8 expref: 9 pid: 6681 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.514481:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002af35e79/0x7a8dd0fcbb9253ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2d8 expref: 9 pid: 6681 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.514499:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789438270.514503:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789438270.514509:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb92542e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.514519:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb92542e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.514559:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438270.514629:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff9e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+8:2356:x1876361749774720:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 238us (9786us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438270.514638:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 50 00010000:00010000:3.0:1789438270.515763:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb92542e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.515779:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb92542e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.515808:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb92542e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.515817:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb92542e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.515837:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb92542e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.515845:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dae00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:3.0:1789438270.515850:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb92542e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.515859:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb92542e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.515875:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb92542e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.515882:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa071249/0x7a8dd0fcbb92542e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438270.515955:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+7:2355:x1876361749774464:12345-192.168.206.9@tcp:1:lfs.0 Request processed in 28921us (29155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438270.515964:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 36 00000100:00100000:2.0:1789438270.521184:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438270.524844:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749774976 00000100:00100000:0.0:1789438270.524860:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749774976 00000100:00100000:0.0:1789438270.524942:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 26 00000100:00100000:0.0:1789438270.524954:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d21bb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+38:10522:x1876361749774976:12345-192.168.206.9@tcp:35:lfs.0 00000004:00010000:0.0:1789438270.525015:0:5842:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb925420 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2ed expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789438270.525326:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1789438270.525634:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1789438270.526982:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1789438270.527186:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925435 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.527206:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb9253da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2ca expref: 42 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.527215:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925435 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.527334:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb9253da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2ca expref: 42 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.527349:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb9253da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2ca expref: 42 pid: 5839 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438270.527438:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7db6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5842:1876361769715072:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789438270.527586:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f44a76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789438270.539153:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438270.539278:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749775104 00000100:00100000:3.0:1789438270.539288:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749775104 00010000:00010000:3.0:1789438270.539329:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb9253da lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2ca expref: 43 pid: 5839 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438270.539413:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 51 00000100:00100000:3.0:1789438270.539438:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff9e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+43:2353:x1876361749775104:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789438270.539453:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438270.539460:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb9253da lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2ca expref: 43 pid: 5839 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.539475:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb9253da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2ca expref: 43 pid: 5839 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.539496:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991d192c000) 00010000:00010000:3.0:1789438270.539502:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925435 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.539512:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925435 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.539520:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925435 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.539539:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789438270.539613:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff9e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+43:2353:x1876361749775104:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 178us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438270.539621:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 51 00010000:00010000:0.0:1789438270.539736:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb9253da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2ca expref: 42 pid: 5839 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438270.539753:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7db6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5842:1876361769715072:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438270.539774:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925435 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.539784:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925435 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.539790:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925435 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789438270.539916:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1789438270.540138:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1789438270.540241:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7db6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1876361769715200:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789438270.540287:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438270.540317:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f44a7540 going to sleep for 11 seconds 00000100:00100000:0.0:1789438270.541232:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769715200 00000100:00100000:0.0:1789438270.541240:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769715200 00000100:00100000:0.0:1789438270.541283:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789438270.541292:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5842:x1876361769715200:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789438270.541381:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5842:x1876361769715200:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 91us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438270.541388:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789438270.541428:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7db6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1876361769715200:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789438270.542654:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1789438270.542752:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1876361769715328:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789438270.542798:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438270.542823:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f44a76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789438270.542844:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769715328 00000100:00100000:0.0:1789438270.542850:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769715328 00000100:00100000:0.0:1789438270.542877:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789438270.542884:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5842:x1876361769715328:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789438270.543050:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5842:x1876361769715328:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 166us (251us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789438270.543057:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789438270.543110:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1876361769715328:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789438270.543171:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1789438270.543209:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925435 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.543226:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925435 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.543234:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925435 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.543240:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63200 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438270.543245:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925435 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.543252:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925435 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.543267:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991d192c000) 00010000:00010000:0.0:1789438270.543271:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789438270.543276:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925435 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.543282:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925435 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789438270.543439:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789438270.543553:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1789438270.543563:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 322808854944ns, next at 323808852663ns, rc = 0 00000001:00080000:0.0:1789438270.543569:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1789438270.543601:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991d192c000) 00010000:00010000:0.0:1789438270.543604:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789438270.543616:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb925420 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2ed expref: 46 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438270.543751:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d21bb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+45:10522:x1876361749774976:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 18799us (22575us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1789438270.543759:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 26 00000020:00080000:0.0:1789438270.543763:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:2.0:1789438270.547236:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789438270.549882:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438270.550109:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749775232 00000100:00100000:0.0:1789438270.550119:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749775232 00000100:00100000:0.0:1789438270.550183:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 100 00000100:00100000:0.0:1789438270.550194:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+45:10522:x1876361749775232:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:0.0:1789438270.550219:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438270.550257:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92543c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa2f4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.550318:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92543c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2f4 expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.550332:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92543c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2f4 expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.550349:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991c3ac2000) 00010000:00010000:0.0:1789438270.550352:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789438270.550356:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63e00, rc 0) 00000100:00100000:0.0:1789438270.551005:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+46:10522:x1876361749775232:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 810us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438270.551013:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 100 00000100:00100000:1.0:1789438270.565012:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438270.565409:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749775488 00000100:00100000:2.0:1789438270.565420:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749775488 00000100:00100000:2.0:1789438270.565518:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 27 00000100:00100000:2.0:1789438270.565530:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+46:10522:x1876361749775488:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:2.0:1789438270.565818:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+47:10522:x1876361749775488:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 289us (813us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1789438270.565826:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 27 00000100:00100000:2.0:1789438270.679771:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438270.679856:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749775616 00000100:00100000:0.0:1789438270.679873:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749775616 00000100:00100000:0.0:1789438270.679972:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 101 00000100:00100000:0.0:1789438270.679984:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff9e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+47:10532:x1876361749775616:12345-192.168.206.9@tcp:34:lfs.0 00010000:00010000:0.0:1789438270.680059:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb925443 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.680076:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb925443 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.680088:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb925443 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.680115:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb92544a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.680123:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb92544a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.680130:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb92544a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.680218:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925451 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.680226:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.680232:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789438270.680274:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.680300:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb925443 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.680307:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb925443 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.680314:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb925443 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.680320:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d62000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438270.680324:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb925443 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.680332:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb925443 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.680345:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:0.0:1789438270.680348:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438270.680353:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb925443 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.680359:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb925443 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.680371:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb92544a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.680377:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb92544a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.680383:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb92544a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.680394:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63200 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438270.680397:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb92544a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.680403:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb92544a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.680411:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9991c3ac2a00) 00010000:00010000:0.0:1789438270.680413:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438270.680416:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb92544a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.680422:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb92544a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.680437:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.680444:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925451 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.680450:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925451 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.680455:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63c00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438270.680458:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925451 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.680464:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925451 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.680481:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991c3ac2000) 00010000:00010000:0.0:1789438270.680483:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438270.680486:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925451 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.680491:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925451 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438270.680568:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff9e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+47:10532:x1876361749775616:12345-192.168.206.9@tcp:34:lfs.0 Request processed in 586us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438270.680576:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 101 00000100:00100000:3.0:1789438270.719110:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438270.719248:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749775872 00000100:00100000:2.0:1789438270.719259:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749775872 00000100:00100000:2.0:1789438270.719320:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 102 00000100:00100000:2.0:1789438270.719330:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f41cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+47:10535:x1876361749775872:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789438270.719350:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438270.719371:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925458 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa2fb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.719443:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92545f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.719457:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92545f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.719468:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92545f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.719482:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925466 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.719490:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.719497:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.719615:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb92546d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.719623:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb92546d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.719647:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb92546d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438270.719658:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789438270.720118:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92545f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.720128:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92545f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.720135:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92545f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.720141:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438270.720145:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92545f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.720152:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92545f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.720164:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:2.0:1789438270.720167:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438270.720171:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92545f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.720177:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92545f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.720191:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.720197:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925466 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.720209:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925466 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.720214:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0e00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438270.720217:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925466 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.720223:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925466 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.720231:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9991d5872600) 00010000:00010000:2.0:1789438270.720233:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438270.720236:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925466 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.720241:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb925466 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.720282:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925458 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2fb expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.720296:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb92546d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2fb expref: 49 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.720303:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991c3ac2000) 00010000:00010000:2.0:1789438270.720305:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789438270.720307:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f1000, rc 0) 00000100:00100000:2.0:1789438270.720375:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f41cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+49:10535:x1876361749775872:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 1046us (1285us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1789438270.720392:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 102 00000100:00100000:1.0:1789438270.728850:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438270.729242:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749776000 00000100:00100000:2.0:1789438270.729253:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749776000 00000100:00100000:2.0:1789438270.729316:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 103 00000100:00100000:2.0:1789438270.729328:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+49:10535:x1876361749776000:12345-192.168.206.9@tcp:54:lfs.0 00010000:00010000:2.0:1789438270.729395:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb92547b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.729412:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb92547b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.729425:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb92547b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.729452:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb92547b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.729460:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb92547b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.729469:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb92547b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.729475:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438270.729481:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb92547b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.729489:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb92547b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.729501:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991c3ac2000) 00010000:00010000:2.0:1789438270.729517:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789438270.729523:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb92547b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.729530:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb92547b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438270.729657:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+49:10535:x1876361749776000:12345-192.168.206.9@tcp:54:lfs.0 Request processed in 331us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438270.729666:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 103 00000100:00100000:1.0:1789438270.735423:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438270.735531:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749776256 00000100:00100000:0.0:1789438270.735542:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749776256 00000100:00100000:0.0:1789438270.735605:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 28 00000100:00100000:0.0:1789438270.735618:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+49:10535:x1876361749776256:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:0.0:1789438270.735882:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+50:10535:x1876361749776256:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 267us (467us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1789438270.735889:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 28 00000100:00100000:3.0:1789438270.850522:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438270.850631:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749776512 00000100:00100000:0.0:1789438270.850642:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749776512 00000100:00100000:0.0:1789438270.850703:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 104 00000100:00100000:0.0:1789438270.850757:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f41cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+50:10545:x1876361749776512:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:0.0:1789438270.850781:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438270.850785:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789438270.850814:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9253fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2df expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.850852:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:0.0:1789438270.850857:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789438270.850877:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925482 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa302 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.850974:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925489 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.851000:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925489 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.851011:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925489 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438270.851022:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789438270.851159:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925482 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa302 expref: 52 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.851175:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925489 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa302 expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.851183:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991c3ac2000) 00010000:00010000:0.0:1789438270.851186:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789438270.851189:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63200, rc 0) 00000100:00100000:0.0:1789438270.851265:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f41cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+51:10545:x1876361749776512:12345-192.168.206.9@tcp:101:bash.0 Request processed in 511us (752us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1789438270.851278:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 104 00000100:00100000:1.0:1789438270.854567:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438270.854659:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749776768 00000100:00100000:2.0:1789438270.854669:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749776768 00000100:00100000:2.0:1789438270.854779:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 105 00000100:00100000:2.0:1789438270.854790:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+51:10545:x1876361749776768:12345-192.168.206.9@tcp:36:bash.0 00010000:00010000:2.0:1789438270.854849:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789438270.854877:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925489 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa302 expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.854900:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb92546d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2fb expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.854910:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991c3ac2000) 00010000:00010000:2.0:1789438270.854915:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789438270.855132:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925497 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.855146:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925497 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.855157:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925497 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789438270.855224:0:7624:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1789438270.855252:0:7624:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004bfb19aa reply state 00000000abb82a91 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925497 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438270.855261:0:7624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789438270.855359:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+52:10545:x1876361749776768:12345-192.168.206.9@tcp:36:bash.0 Request processed in 570us (800us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789438270.855367:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 105 00000020:00080000:2.0:1789438270.855372:0:7624:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789438270.859529:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438270.859616:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749776896 00000100:00100000:2.0:1789438270.859627:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749776896 00000100:00100000:2.0:1789438270.859683:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 106 00000100:00100000:2.0:1789438270.859693:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+52:10545:x1876361749776896:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:2.0:1789438270.859762:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438270.859782:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb92549e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa309 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.859865:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb9254a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.859877:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925497 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.859885:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb9254a5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.859903:0:5838:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925497 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.859931:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb9254a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.860193:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925497 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.860208:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925497 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.860214:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925497 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.860220:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438270.860224:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925497 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.860231:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925497 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.860246:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991c3ac2000) 00010000:00010000:0.0:1789438270.860248:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438270.860251:0:3296:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb9254a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.860259:0:3296:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb9254a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.860267:0:3296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb9254a5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.860295:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925497 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.860302:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925497 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.861851:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb9254a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.861867:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb9254a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438270.861917:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789438270.861921:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789438270.861943:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb9254a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.861982:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb92549e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa309 expref: 53 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.862008:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb9254a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa309 expref: 52 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.862016:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991c3ac2000) 00010000:00010000:2.0:1789438270.862019:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789438270.862023:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f0400, rc 0) 00000100:00100000:2.0:1789438270.862160:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+52:10545:x1876361749776896:12345-192.168.206.9@tcp:101:bash.0 Request processed in 2466us (2639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438270.862169:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 106 00000100:00100000:1.0:1789438270.876824:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438270.876883:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749777152 00000100:00100000:0.0:1789438270.876907:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749777152 00000100:00100000:0.0:1789438270.876963:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 29 00000100:00100000:0.0:1789438270.876976:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+52:10545:x1876361749777152:12345-192.168.206.9@tcp:35:bash.0 00000100:00100000:0.0:1789438270.877226:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+53:10545:x1876361749777152:12345-192.168.206.9@tcp:35:bash.0 Request processed in 252us (411us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1789438270.877234:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 29 00000100:00100000:1.0:1789438270.934864:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438270.934916:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438270.935006:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749777408 00000100:00100000:3.0:1789438270.935017:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749777408 00000100:00100000:3.0:1789438270.935091:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 73 00000100:00100000:3.0:1789438270.935113:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+8:2353:x1876361749777408:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438270.935216:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+8:2353:x1876361749777408:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 106us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438270.935224:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 73 00000100:00100000:2.0:1789438270.935515:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749777280 00000100:00100000:2.0:1789438270.935520:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749777280 00000100:00100000:2.0:1789438270.935559:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 283 00000100:00100000:2.0:1789438270.935575:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+13:2353:x1876361749777280:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789438270.935609:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+13:2353:x1876361749777280:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 36us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438270.935616:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 283 00000100:00100000:1.0:1789438270.937136:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438270.937238:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749777536 00000100:00100000:2.0:1789438270.937247:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749777536 00000100:00100000:2.0:1789438270.937326:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 132 00000100:00100000:2.0:1789438270.937335:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2354:x1876361749777536:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789438270.937404:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2354:x1876361749777536:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 70us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438270.937411:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 132 00000100:00080000:0.0:1789438270.937832:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789438270.945055:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438270.945201:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749777664 00000100:00100000:3.0:1789438270.945213:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749777664 00000100:00100000:3.0:1789438270.945289:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 107 00000100:00100000:3.0:1789438270.945300:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+53:10551:x1876361749777664:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:3.0:1789438270.945326:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438270.945350:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9254ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa310 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.945422:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9254b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.945437:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9254b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.945448:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9254b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789438270.945481:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789438270.945484:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789438270.945502:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9254b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.945524:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9254ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa310 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.945544:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9254b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa310 expref: 54 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.945564:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:3.0:1789438270.945567:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789438270.945570:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a55800, rc 0) 00000100:00100000:3.0:1789438270.945632:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+54:10551:x1876361749777664:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 334us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438270.945639:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 107 00000100:00100000:0.0:1789438270.952132:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438270.952331:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749777792 00000100:00100000:2.0:1789438270.952342:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749777792 00000100:00100000:2.0:1789438270.952405:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 108 00000100:00100000:2.0:1789438270.952417:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+54:10551:x1876361749777792:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789438270.952437:0:7624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438270.952463:0:7624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb9254ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa317 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.952526:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9254c1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.952541:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9254c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.952554:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9254c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.952591:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb9254c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.952599:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb9254c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.952607:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb9254c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.952728:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb9254cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.952738:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb9254cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.952745:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb9254cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438270.952789:0:7624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789438270.952794:0:7624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789438270.952812:0:7624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb9254cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.952824:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb9254cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.952834:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9254c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.953157:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9254c1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.953176:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9254c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.953183:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f1000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438270.953187:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9254c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.953196:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9254c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.953209:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:2.0:1789438270.953213:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438270.953298:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9254c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.953307:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9254c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.953324:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb9254c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.953330:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb9254c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.953336:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb9254c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.953342:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438270.953345:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb9254c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.953364:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb9254c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.953373:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9991d5872600) 00010000:00010000:2.0:1789438270.953376:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438270.953379:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb9254c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.953385:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb9254c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.953426:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb9254ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa317 expref: 56 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.953441:0:7624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb9254cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa317 expref: 55 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.953448:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991c3ac2000) 00010000:00010000:2.0:1789438270.953450:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789438270.953453:0:7624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f0a00, rc 0) 00000100:00100000:2.0:1789438270.953579:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+55:10551:x1876361749777792:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 1163us (1454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438270.953588:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 108 00000100:00100000:1.0:1789438270.958365:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438270.958449:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438270.958527:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749778176 00000100:00100000:0.0:1789438270.958537:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749778176 00000100:00100000:0.0:1789438270.958630:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:0.0:1789438270.958641:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa7cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1274be99-2d57-4dac-a13e-a89426512ee0+55:2356:x1876361749778176:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789438270.958658:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438270.958684:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb9254cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa317 expref: 55 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.958703:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991c3ac2000) 00010000:00010000:0.0:1789438270.958734:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438270.958789:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa7cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1274be99-2d57-4dac-a13e-a89426512ee0+54:2356:x1876361749778176:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 150us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438270.958796:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:3.0:1789438270.959805:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749778048 00000100:00100000:3.0:1789438270.959816:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749778048 00000100:00100000:3.0:1789438270.959878:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 109 00000100:00100000:3.0:1789438270.959888:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa7ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+54:10551:x1876361749778048:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:3.0:1789438270.959908:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438270.959927:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9254d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa31e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.960038:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb9254dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.960053:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb9254a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa309 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.960062:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb9254dd lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.960109:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb9254a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa309 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438270.960123:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb9254a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa309 expref: 55 pid: 5838 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438270.960153:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f41cea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876361769715456:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789438270.964242:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c81580c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438270.965987:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f41cea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876361769715456:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789438270.966018:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb9254dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438270.969438:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438270.969573:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749778304 00000100:00100000:1.0:1789438270.969584:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749778304 00010000:00010000:2.0:1789438270.969692:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb9254a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa309 expref: 56 pid: 5838 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438270.971510:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 52 00000100:00100000:2.0:1789438270.971547:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+56:2353:x1876361749778304:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789438270.971566:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438270.971577:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb9254a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa309 expref: 56 pid: 5838 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.971597:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb9254a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa309 expref: 56 pid: 5838 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.971626:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb9254a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa309 expref: 56 pid: 5838 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.971645:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991c3ac2000) 00010000:00010000:2.0:1789438270.971651:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb9254dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.971662:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb9254dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.971671:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb9254dd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438270.971734:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789438270.971796:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+55:2353:x1876361749778304:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 257us (2365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438270.971804:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 52 00010000:00010000:0.0:1789438270.971939:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb9254dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.971947:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb9254dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438270.971966:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789438270.972151:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9254d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa31e expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.972168:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb9254dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa31e expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.972175:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991c3ac2000) 00010000:00010000:0.0:1789438270.972177:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789438270.972180:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a54a00, rc 0) 00000100:00100000:0.0:1789438270.972207:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa7ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+55:10551:x1876361749778048:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 12321us (13852us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1789438270.972215:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 109 00000100:00100000:3.0:1789438270.975570:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438270.975664:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749778560 00000100:00100000:1.0:1789438270.975676:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749778560 00000100:00100000:1.0:1789438270.975779:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 8 00000100:00100000:1.0:1789438270.975791:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f41cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+55:10551:x1876361749778560:12345-192.168.206.9@tcp:103:lfs.0 00010000:00010000:1.0:1789438270.975808:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438270.975832:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92543c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2f4 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.975852:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991c3ac2000) 00010000:00010000:1.0:1789438270.975857:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438270.975914:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f41cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+54:10551:x1876361749778560:12345-192.168.206.9@tcp:103:lfs.0 Request processed in 127us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438270.975934:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 8 00000100:00100000:3.0:1789438270.979205:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438270.979545:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749778688 00000100:00100000:1.0:1789438270.979556:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749778688 00000100:00100000:1.0:1789438270.979617:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 110 00000100:00100000:1.0:1789438270.979628:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f41cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+54:10551:x1876361749778688:12345-192.168.206.9@tcp:58:lfs.0 00010000:00010000:1.0:1789438270.979766:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9254eb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.979784:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9254eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438270.979796:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9254eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789438270.980527:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1789438270.980639:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f41cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+54:10551:x1876361749778688:12345-192.168.206.9@tcp:58:lfs.0 Request processed in 1009us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438270.980650:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 110 00000100:00100000:2.0:1789438270.983403:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438270.983504:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749778816 00000100:00100000:0.0:1789438270.983514:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749778816 00000100:00100000:0.0:1789438270.983569:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 111 00000100:00100000:0.0:1789438270.983579:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+54:10551:x1876361749778816:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:0.0:1789438270.983597:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438270.983615:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb9254f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa325 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.983669:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9254eb lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.983680:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb9254f2 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa325 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.983699:0:5838:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9254eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.983768:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb9254f2 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa325 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.983781:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991c3ac2000) 00010000:00010000:0.0:1789438270.983784:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789438270.983788:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb9254f2 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa325 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438270.983796:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d62000, rc 0) 00000100:00100000:0.0:1789438270.983865:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+55:10551:x1876361749778816:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 287us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438270.983872:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 111 00010000:00010000:2.0:1789438271.350946:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789438271.415482:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789438271.415492:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789438271.415537:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1789438271.415543:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789438271.415667:0:11668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d04b2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11668:1876361769715584:192.168.206.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789438271.417620:0:11668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f44a7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789438271.435797:0:11668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d04b2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11668:1876361769715584:192.168.206.9@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789438271.436748:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438271.442529:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749778944 00000100:00100000:0.0:1789438271.442555:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749778944 00000100:00100000:1.0:1789438271.442703:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 112 00000100:00100000:1.0:1789438271.442737:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+55:10552:x1876361749778944:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789438271.442770:0:7624:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789438271.442895:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+55:10552:x1876361749778944:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 Request processed in 163us (6150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438271.442903:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 112 00000100:00100000:2.0:1789438271.457510:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438271.458126:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749779072 00000100:00100000:0.0:1789438271.458138:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749779072 00000100:00100000:0.0:1789438271.458200:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 113 00000100:00100000:0.0:1789438271.458213:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+55:10552:x1876361749779072:12345-192.168.206.9@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789438271.458304:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9254f9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.458321:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9254f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.458332:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9254f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.458397:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925500 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.458405:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925500 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.458412:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925500 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.458436:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925507 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.458444:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925507 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.458450:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925507 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438271.458487:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789438271.458491:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789438271.458504:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925507 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.458515:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9254f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.458529:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9254f9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.458536:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9254f9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.458541:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d62600 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438271.458546:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9254f9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.458553:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9254f9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.458564:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9991d5872000) 00010000:00010000:0.0:1789438271.458567:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438271.458573:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9254f9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.458578:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9254f9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.458593:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925500 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.458598:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925500 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.458604:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925500 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.458609:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d62c00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438271.458619:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925500 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.458625:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925500 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.458633:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9991c3ac2a00) 00010000:00010000:0.0:1789438271.458635:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438271.458638:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925500 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.458643:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925500 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.458657:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925507 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.458663:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925507 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.458668:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925507 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.458673:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63e00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438271.458675:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925507 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.458681:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925507 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.458687:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991c3ac2000) 00010000:00010000:0.0:1789438271.458689:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438271.458698:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925507 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.458765:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925507 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438271.458855:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+55:10552:x1876361749779072:12345-192.168.206.9@tcp:34:lhsmtool_posix.0 Request processed in 645us (1354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438271.458863:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 113 00000100:00100000:2.0:1789438271.466599:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438271.466752:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749779328 00000100:00100000:1.0:1789438271.466763:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749779328 00000100:00100000:1.0:1789438271.466823:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 114 00000100:00100000:1.0:1789438271.466848:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+55:10552:x1876361749779328:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789438271.466870:0:7624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438271.466891:0:7624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb92550e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa32c expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.467000:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb925515 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.467016:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb925515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.467040:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb925515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438271.467052:0:7624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789438271.467153:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb925515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.467161:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb925515 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.467167:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb925515 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.467173:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9da000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438271.467178:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb925515 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.467185:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb925515 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.467196:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991c3ac2000) 00010000:00010000:1.0:1789438271.467204:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789438271.467210:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb925515 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.467216:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb925515 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.467259:0:7624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb92550e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa32c expref: 57 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.467270:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9991d5872000) 00010000:00010000:1.0:1789438271.467272:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789438271.467276:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb92550e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa32c expref: 57 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.467285:0:7624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9dae00, rc 0) 00000100:00100000:1.0:1789438271.467341:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+56:10552:x1876361749779328:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 496us (750us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1789438271.467349:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 114 00000100:00100000:1.0:1789438271.473317:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438271.473441:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749779456 00000100:00100000:0.0:1789438271.473452:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749779456 00000100:00100000:0.0:1789438271.473515:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 115 00000100:00100000:0.0:1789438271.473526:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa7cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+56:10552:x1876361749779456:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789438271.473563:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789438271.473669:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa7cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+56:10552:x1876361749779456:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 Request processed in 145us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438271.473676:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 115 00000100:00100000:2.0:1789438271.477053:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438271.477151:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749779712 00000100:00100000:0.0:1789438271.477161:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749779712 00000100:00100000:0.0:1789438271.477219:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 116 00000100:00100000:0.0:1789438271.477229:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa74bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+56:10552:x1876361749779712:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789438271.477248:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438271.477251:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789438271.477279:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9254b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa310 expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.477296:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:0.0:1789438271.477301:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789438271.477329:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925523 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa333 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789438271.478023:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1789438271.478250:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb92552a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.478264:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb92552a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.478275:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb92552a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.478329:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925523 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa333 expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.478347:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb92552a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa333 expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.478355:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9991c3ac2a00) 00010000:00010000:0.0:1789438271.478358:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789438271.478361:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d62c00, rc 0) 00000100:00100000:0.0:1789438271.478415:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa74bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+57:10552:x1876361749779712:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 1187us (1369us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1789438271.478422:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 116 00000100:00100000:2.0:1789438271.485070:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438271.485160:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749779968 00000100:00100000:0.0:1789438271.485171:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749779968 00000100:00100000:0.0:1789438271.485236:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 117 00000100:00100000:0.0:1789438271.485247:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+57:10552:x1876361749779968:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789438271.485319:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438271.485347:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb92552a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa333 expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.485366:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9991c3ac2a00) 00010000:00010000:0.0:1789438271.485376:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789438271.485397:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb925538 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.485411:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb925538 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.485421:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb925538 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.485493:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb92553f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x5e1b9133 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.485502:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb92553f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5e1b9133 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.485509:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb92553f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5e1b9133 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.485571:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb925538 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.485580:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb925538 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.485587:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb925538 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.485602:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d62600 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438271.485607:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb925538 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.485616:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb925538 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.485626:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:0.0:1789438271.485629:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438271.485633:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb925538 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.485640:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb925538 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.485663:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb92553f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5e1b9133 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.485670:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb92553f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5e1b9133 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.485676:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb92553f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5e1b9133 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.485682:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63c00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438271.485685:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb92553f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5e1b9133 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.485691:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb92553f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5e1b9133 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.485750:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x5e1b9133 (ffff9991c3ac2200) 00010000:00010000:0.0:1789438271.485753:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438271.485756:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb92553f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5e1b9133 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.485762:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb92553f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5e1b9133 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438271.485841:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+56:10552:x1876361749779968:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 596us (780us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789438271.485850:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 117 00000100:00100000:1.0:1789438271.489290:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438271.489371:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749780096 00000100:00100000:2.0:1789438271.489381:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749780096 00000100:00100000:2.0:1789438271.489435:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 118 00000100:00100000:2.0:1789438271.489444:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa7cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+56:10552:x1876361749780096:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789438271.489474:0:7624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438271.489501:0:7624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925546 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa33a expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.489534:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92554d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.489547:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92554d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.489558:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92554d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.489660:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925546 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa33a expref: 58 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.489677:0:7624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92554d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa33a expref: 57 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.489685:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9991d5872600) 00010000:00010000:2.0:1789438271.489689:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789438271.489698:0:7624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f1800, rc 0) 00000100:00100000:2.0:1789438271.489786:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa7cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+57:10552:x1876361749780096:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 342us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438271.489794:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 118 00000100:00100000:2.0:1789438271.498798:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438271.498895:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749780352 00000100:00100000:3.0:1789438271.498906:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749780352 00000100:00100000:3.0:1789438271.498968:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 119 00000100:00100000:3.0:1789438271.498979:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+57:10552:x1876361749780352:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789438271.499073:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925554 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.499099:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925554 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.499111:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925554 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789438271.499358:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1789438271.499367:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 323764658940ns, next at 324764656975ns, rc = 0 00000004:00010000:3.0:1789438271.499450:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a1931faf reply state 00000000ac6d1833 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925554 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438271.499460:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789438271.499572:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+59:10552:x1876361749780352:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 593us (781us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1789438271.499579:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 119 00000100:00100000:3.0:1789438271.501759:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438271.501823:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749780480 00000100:00100000:2.0:1789438271.501834:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749780480 00000100:00100000:2.0:1789438271.501896:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 120 00000100:00100000:2.0:1789438271.501908:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f41ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+59:10552:x1876361749780480:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789438271.501945:0:7624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438271.501965:0:7624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92555b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa341 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.502021:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92555b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa341 expref: 60 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.502036:0:7624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92555b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa341 expref: 60 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.502058:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9991d5872600) 00010000:00010000:2.0:1789438271.502061:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789438271.502064:0:7624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f1400, rc 0) 00000100:00100000:2.0:1789438271.502133:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f41ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+60:10552:x1876361749780480:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 227us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438271.502140:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 120 00010000:00010000:1.0:1789438271.502309:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925554 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.502318:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925554 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.502324:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925554 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.502330:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438271.502347:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925554 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.502357:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925554 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.502370:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9991d5872600) 00010000:00010000:1.0:1789438271.502373:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789438271.502377:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925554 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.502384:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925554 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438271.505633:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438271.505742:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749780608 00000100:00100000:0.0:1789438271.505751:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749780608 00000100:00100000:0.0:1789438271.505820:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 37 00000100:00100000:0.0:1789438271.505831:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1274be99-2d57-4dac-a13e-a89426512ee0+8:2353:x1876361749780608:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789438271.506139:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1274be99-2d57-4dac-a13e-a89426512ee0+9:2353:x1876361749780608:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 Request processed in 309us (514us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789438271.506148:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 37 00000100:00080000:2.0:1789438271.506784:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789438271.521147:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438271.522345:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749780864 00000100:00100000:0.0:1789438271.522358:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749780864 00000100:00100000:0.0:1789438271.522431:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 30 00000100:00100000:0.0:1789438271.522443:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f41cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+59:10552:x1876361749780864:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789438271.522757:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f41cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+60:10552:x1876361749780864:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 Request processed in 315us (1617us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1789438271.522766:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 30 00000100:00100000:1.0:1789438271.542691:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438271.543057:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749781120 00000100:00100000:3.0:1789438271.543067:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749781120 00000100:00100000:3.0:1789438271.543139:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 121 00000100:00100000:3.0:1789438271.543150:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+60:10552:x1876361749781120:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789438271.543275:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+60:10552:x1876361749781120:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 127us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438271.543283:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 121 00000100:00100000:1.0:1789438271.549481:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438271.549582:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749781248 00000100:00100000:2.0:1789438271.549593:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749781248 00000100:00100000:2.0:1789438271.549664:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 122 00000100:00100000:2.0:1789438271.549681:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+60:10552:x1876361749781248:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789438271.549731:0:7624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438271.549753:0:7624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb925562 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa348 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.549833:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925569 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.549848:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.549859:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438271.549895:0:7624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789438271.549925:0:7624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.549952:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb925562 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa348 expref: 62 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.549972:0:7624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925569 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa348 expref: 61 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.549981:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9991d5872600) 00010000:00010000:2.0:1789438271.549983:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789438271.549987:0:7624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f0000, rc 0) 00000100:00100000:2.0:1789438271.550060:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+61:10552:x1876361749781248:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 379us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438271.550077:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 122 00000100:00100000:2.0:1789438271.555088:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438271.555183:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749781376 00000100:00100000:3.0:1789438271.555193:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749781376 00000100:00100000:3.0:1789438271.555259:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 38 00000100:00100000:3.0:1789438271.555271:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+9:2354:x1876361749781376:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789438271.555288:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438271.555308:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb925570 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa34f expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789438271.555331:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa8a93f, blocks: 0x1 00010000:00010000:3.0:1789438271.555352:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=323s v=(0 0) 00010000:00010000:3.0:1789438271.555357:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438271.555365:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb925570 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa34f expref: 10 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.555382:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb925570 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa34f expref: 10 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.555410:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a54800, rc 0) 00000100:00100000:3.0:1789438271.555472:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+10:2354:x1876361749781376:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 204us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438271.555480:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 38 00000100:00100000:1.0:1789438271.558238:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438271.558410:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749781632 00000100:00100000:3.0:1789438271.558420:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749781632 00000100:00100000:3.0:1789438271.558483:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 123 00000100:00100000:3.0:1789438271.558493:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+61:10552:x1876361749781632:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789438271.558601:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+61:10552:x1876361749781632:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 109us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438271.558608:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 123 00000100:00100000:2.0:1789438271.562611:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438271.563206:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749781760 00000100:00100000:0.0:1789438271.563230:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749781760 00000100:00100000:0.0:1789438271.563294:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 39 00000100:00100000:0.0:1789438271.563304:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1274be99-2d57-4dac-a13e-a89426512ee0+10:10552:x1876361749781760:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789438271.563321:0:8192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438271.563339:0:8192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022926216/0x7a8dd0fcbb925577 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa356 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.563373:0:8192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb925570 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa34f expref: 11 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.563382:0:8192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789438271.563386:0:8192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789438271.563392:0:8192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022926216/0x7a8dd0fcbb925577 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa356 expref: 11 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.563426:0:8192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb925570 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa34f expref: 11 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.563439:0:8192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb925570 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa34f expref: 11 pid: 6682 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438271.563453:0:8192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d04b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8192:1876361769715712:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789438271.563563:0:8192:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f44a7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789438271.570458:0:8192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d04b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8192:1876361769715712:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438271.570499:0:8192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000022926216/0x7a8dd0fcbb925577 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa356 expref: 11 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.570541:0:8192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63c00, rc 0) 00000100:00100000:0.0:1789438271.570607:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1274be99-2d57-4dac-a13e-a89426512ee0+11:10552:x1876361749781760:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 7303us (8003us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438271.570616:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 39 00000100:00100000:1.0:1789438271.572646:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438271.572768:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749781888 00000100:00100000:3.0:1789438271.572779:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749781888 00010000:00010000:3.0:1789438271.572818:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb925570 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa34f expref: 11 pid: 6682 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438271.572863:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 53 00000100:00100000:3.0:1789438271.572873:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d055d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+11:2353:x1876361749781888:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789438271.572889:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438271.572909:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb925570 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa34f expref: 11 pid: 6682 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.572923:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb925570 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa34f expref: 11 pid: 6682 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.572961:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb925570 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa34f expref: 11 pid: 6682 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.572979:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438271.572983:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438271.572992:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000022926216/0x7a8dd0fcbb925577 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa356 expref: 10 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.573002:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022926216/0x7a8dd0fcbb925577 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa356 expref: 10 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.573054:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000022926216/0x7a8dd0fcbb925577 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa356 expref: 10 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438271.573071:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f41cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5824:1876361769715840:192.168.206.9@tcp:105: 00000100:00100000:3.0:1789438271.573168:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c81583c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438271.575346:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f41cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5824:1876361769715840:192.168.206.9@tcp:105: 00010000:00010000:3.0:1789438271.575373:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789438271.575429:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d055d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+10:2353:x1876361749781888:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 2556us (2789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438271.575439:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 53 00000100:00100000:0.0:1789438271.578609:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438271.579010:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749782016 00000100:00100000:1.0:1789438271.579032:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749782016 00002000:00100000:1.0:1789438271.579085:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9991d04b2680 x1876361749782016/t0(0) o4->1274be99-2d57-4dac-a13e-a89426512ee0@192.168.206.9@tcp:702/0 lens 504/0 e 0 to 0 dl 1789438282 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789438271.579108:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9991d04b2680 with x1876361749782016 ext(0->12) 00002000:00010000:1.0:1789438271.579114:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9991d04b2680 00000100:00100000:1.0:1789438271.579187:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 2 00000100:00100000:1.0:1789438271.579199:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1274be99-2d57-4dac-a13e-a89426512ee0+10:2354:x1876361749782016:12345-192.168.206.9@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789438271.579807:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1274be99-2d57-4dac-a13e-a89426512ee0+12:2354:x1876361749782016:12345-192.168.206.9@tcp:4:lhsmtool_posix.0 Request processed in 607us (1203us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789438271.579825:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 2 00002000:00100000:1.0:1789438271.579834:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9991d04b2680 x1876361749782016/t4294967308(0) o4->1274be99-2d57-4dac-a13e-a89426512ee0@192.168.206.9@tcp:702/0 lens 504/448 e 0 to 0 dl 1789438282 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789438271.579854:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9991d04b2680 with x1876361749782016 ext(0->12) 00002000:00010000:1.0:1789438271.579859:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9991d04b2680 00000100:00100000:3.0:1789438271.582799:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438271.583108:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749782144 00000100:00100000:2.0:1789438271.583118:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749782144 00000100:00100000:2.0:1789438271.583217:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 124 00000100:00100000:2.0:1789438271.583241:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f41cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+61:10552:x1876361749782144:12345-192.168.206.9@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1789438271.613526:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f41cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+61:10552:x1876361749782144:12345-192.168.206.9@tcp:44:lhsmtool_posix.0 Request processed in 30279us (30725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438271.613554:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 124 00000100:00100000:2.0:1789438271.615882:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438271.615967:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749782272 00000100:00100000:3.0:1789438271.615978:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749782272 00000100:00100000:3.0:1789438271.616142:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 40 00000100:00100000:3.0:1789438271.616154:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+12:2354:x1876361749782272:12345-192.168.206.9@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789438271.616421:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1789438271.616448:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1789438271.616462:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9991f44a7540 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1789438271.616466:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9991f3d34b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9991f44a7e40 00000020:00080000:1.0:1789438271.616470:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9991f3d34e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9991c6c4f400 00000004:00080000:1.0:1789438271.616497:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:1.0:1789438271.616550:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789438271.616561:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9991fabaa0c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1789438271.616564:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9991d0446500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9991c684de40 00000020:00080000:1.0:1789438271.616567:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9991d0446300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9991fabe4000 00000020:00080000:1.0:1789438271.616583:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1789438271.616790:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1789438271.616898:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991facb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769715968:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789438271.616948:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438271.622946:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d04b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769716224:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789438271.623042:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991facb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769716096:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789438271.624045:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438271.624932:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769715968 00000100:00100000:2.0:1789438271.624943:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769715968 00000100:00100000:1.0:1789438271.625086:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769716096 00000100:00100000:1.0:1789438271.625103:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769716096 00000100:00100000:1.0:1789438271.625138:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789438271.625148:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3309:x1876361769716096:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789438271.625792:0:8192:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789438271.625798:0:8192:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789438271 00002000:00010000:1.0:1789438271.625801:0:8192:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789438271.625803:0:8192:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789438271 -> 1789438271 00002000:00010000:1.0:1789438271.625806:0:8192:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789438271.625872:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3309:x1876361769716096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 725us (1830us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789438271.625880:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789438271.625900:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789438271.625907:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1876361769715968:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789438271.625923:0:8192:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:1.0:1789438271.625944:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb92557e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.625966:0:8192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925340 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2b5 expref: 12 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.625975:0:8192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1789438271.625980:0:8192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789438271.625985:0:8192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb92557e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789438271.626154:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9991facb5500/2, rc 0, transno 4294967309 00000100:00100000:2.0:1789438271.626161:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991facb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769716096:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1789438271.626210:0:8192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925340 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2b5 expref: 12 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.626300:0:8192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925340 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2b5 expref: 12 pid: 6682 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438271.626327:0:8192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991facb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8192:1876361769716352:192.168.206.9@tcp:104: 00000100:00100000:1.0:1789438271.626445:0:8192:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e07f9300 going to sleep for 11 seconds 00000100:00100000:1.0:1789438271.626464:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438271.626500:0:6681:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789438271.626507:0:6681:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1789438271.626616:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769716224 00000100:00100000:1.0:1789438271.626622:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769716224 00000100:00100000:1.0:1789438271.626700:0:11995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789438271.626741:0:11995:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3310:x1876361769716224:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789438271.626771:0:11995:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1789438271.626795:0:11995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa8a93e, atime: 0x6aa8a93e, ctime: 0x6aa8a93e, blocks: 0x1 00010000:00010000:1.0:1789438271.626801:0:11995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925585 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.626811:0:11995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=323s v=(0 0) 00010000:00010000:1.0:1789438271.626814:0:11995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438271.626820:0:11995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925585 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.626835:0:11995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925585 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.626845:0:11995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925585 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.626864:0:11995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925585 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.626880:0:11995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789438271.626892:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789438271.626898:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925585 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.626906:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dbe00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:1.0:1789438271.626910:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925585 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.626919:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925585 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.626936:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925585 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.626943:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925585 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.626959:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438271.626961:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438271.626963:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438271.627621:0:11995:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3310:x1876361769716224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 911us (1154us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789438271.627637:0:11995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:1.0:1789438271.627686:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9991d04b0700/2, rc 0, transno 4294967304 00000100:00100000:1.0:1789438271.627692:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d04b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769716224:0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1789438271.630650:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789438271.636559:0:8192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991facb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8192:1876361769716352:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789438271.636595:0:8192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb92557e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438271.636704:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438271.636782:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749782400 00000100:00100000:2.0:1789438271.636789:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749782400 00010000:00010000:2.0:1789438271.636825:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925340 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2b5 expref: 13 pid: 6682 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438271.637981:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 54 00000100:00100000:2.0:1789438271.637996:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+13:2353:x1876361749782400:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789438271.638012:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438271.638045:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925340 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2b5 expref: 13 pid: 6682 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.638059:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925340 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2b5 expref: 13 pid: 6682 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.638083:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925340 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa2b5 expref: 13 pid: 6682 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.638110:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789438271.638114:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789438271.638119:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb92557e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.638129:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb92557e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.638155:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789438271.638206:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+12:2353:x1876361749782400:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 216us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438271.638426:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 54 00010000:00010000:2.0:1789438271.638460:0:8192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb92557e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.638471:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb92557e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.638494:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb92557e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.638502:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb92557e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.638558:0:8192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789438271.639120:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3312:x1876361769715968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13212us (22169us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789438271.639129:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:2.0:1789438271.639179:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9991facb6a00/2, rc 0, transno 4294967310 00000100:00100000:2.0:1789438271.639186:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991facb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769715968:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789438271.643446:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789438271.643459:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb92557e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.643472:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dba00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:1.0:1789438271.643477:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb92557e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.643488:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb92557e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.643509:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb92557e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.643516:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb92557e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.643536:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438271.643537:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438271.643539:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438271.659106:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+11:2354:x1876361749782272:12345-192.168.206.9@tcp:16:lhsmtool_posix.0 Request processed in 42933us (43209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438271.659120:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 40 00000001:00080000:2.0:1789438271.660477:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:2.0:1789438271.660496:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1789438271.660508:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:2.0:1789438271.662218:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438271.662389:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749782656 00000100:00100000:3.0:1789438271.662400:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749782656 00000100:00100000:3.0:1789438271.662496:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 125 00000100:00100000:3.0:1789438271.662508:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+15:10552:x1876361749782656:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789438271.662560:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438271.662588:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925569 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa348 expref: 15 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.662605:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9991d5872600) 00010000:00010000:3.0:1789438271.662610:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789438271.662640:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92558c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.662653:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92558c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.662663:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92558c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789438271.662972:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f48fe91 reply state 000000001b91b2ff transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92558c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438271.662982:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789438271.663163:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+16:10552:x1876361749782656:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 656us (950us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1789438271.663171:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 125 00000100:00100000:1.0:1789438271.666290:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438271.666658:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749782784 00000100:00100000:2.0:1789438271.666669:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749782784 00000100:00100000:2.0:1789438271.666753:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 44 00000100:00100000:2.0:1789438271.666764:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1274be99-2d57-4dac-a13e-a89426512ee0+6:2354:x1876361749782784:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789438271.666978:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789438271.666981:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789438271 -> 1789438270 00002000:00010000:2.0:1789438271.666984:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789438270 00002000:00010000:2.0:1789438271.666986:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789438271 -> 1789438270 00002000:00010000:2.0:1789438271.666988:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789438271.667075:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1274be99-2d57-4dac-a13e-a89426512ee0+7:2354:x1876361749782784:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 Request processed in 313us (793us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789438271.667083:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 44 00000100:00100000:2.0:1789438271.669183:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438271.669325:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749783040 00000100:00100000:1.0:1789438271.669334:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749783040 00000100:00100000:1.0:1789438271.669401:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 126 00000100:00100000:1.0:1789438271.669411:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff98f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+16:10552:x1876361749783040:12345-192.168.206.9@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789438271.669475:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925593 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.669492:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92554d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa33a expref: 16 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.669503:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925593 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.669540:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92554d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa33a expref: 16 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.669554:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92554d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa33a expref: 16 pid: 7624 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438271.669570:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991facb4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876361769716480:192.168.206.9@tcp:104: 00000100:00100000:1.0:1789438271.669651:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e07f99c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789438271.673140:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92558c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.673159:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92558c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.673168:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92558c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.673175:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438271.673180:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92558c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.673189:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92558c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.673208:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9991d5872600) 00010000:00010000:0.0:1789438271.673211:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438271.673335:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92558c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.673363:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb92558c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438271.675230:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991facb4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876361769716480:192.168.206.9@tcp:104: 00010000:00010000:1.0:1789438271.675260:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925593 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438271.676701:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438271.676820:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749783168 00000100:00100000:3.0:1789438271.676830:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749783168 00010000:00010000:3.0:1789438271.676883:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92554d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa33a expref: 16 pid: 7624 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438271.676925:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 55 00000100:00100000:3.0:1789438271.676935:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa644700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+16:2354:x1876361749783168:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789438271.676951:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438271.676959:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92554d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa33a expref: 16 pid: 7624 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.676972:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92554d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa33a expref: 16 pid: 7624 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.676994:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92554d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa33a expref: 16 pid: 7624 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.677011:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9991d5872600) 00010000:00010000:3.0:1789438271.677016:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925593 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.677042:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925593 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.677050:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925593 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.677074:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789438271.677143:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa644700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+15:2354:x1876361749783168:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 208us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438271.677152:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 55 00010000:00010000:1.0:1789438271.678679:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925593 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.678695:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925593 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.678783:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925593 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.678791:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925593 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.678798:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925593 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.678805:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dbe00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438271.678810:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925593 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.678818:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925593 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.678834:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9991d5872600) 00010000:00010000:1.0:1789438271.678848:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789438271.678852:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925593 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.678858:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925593 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438271.678937:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff98f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+14:10552:x1876361749783040:12345-192.168.206.9@tcp:55:lhsmtool_posix.0 Request processed in 9524us (9757us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789438271.678947:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 126 00000100:00100000:2.0:1789438271.682238:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438271.682340:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749783296 00000100:00100000:0.0:1789438271.682351:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749783296 00000100:00100000:0.0:1789438271.682411:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 45 00000100:00100000:0.0:1789438271.682421:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+7:2356:x1876361749783296:12345-192.168.206.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789438271.682466:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001a33d9fe/0x7a8dd0fcbb92559a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.682500:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000022926216/0x7a8dd0fcbb925577 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa356 expref: 7 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.682510:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789438271.682514:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789438271.682519:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a33d9fe/0x7a8dd0fcbb92559a lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.682555:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000022926216/0x7a8dd0fcbb925577 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa356 expref: 7 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.682569:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000022926216/0x7a8dd0fcbb925577 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa356 expref: 7 pid: 8192 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438271.682584:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d04b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876361769716608:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789438271.682661:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991ff88d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438271.687967:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438271.688251:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d04b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876361769716608:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438271.688279:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001a33d9fe/0x7a8dd0fcbb92559a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438271.688359:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749783424 00000100:00100000:2.0:1789438271.688368:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749783424 00010000:00010000:2.0:1789438271.688404:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000022926216/0x7a8dd0fcbb925577 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa356 expref: 8 pid: 8192 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438271.688447:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 56 00000100:00100000:2.0:1789438271.688457:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f41cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+8:2354:x1876361749783424:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789438271.688473:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438271.688493:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000022926216/0x7a8dd0fcbb925577 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa356 expref: 8 pid: 8192 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.688506:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000022926216/0x7a8dd0fcbb925577 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa356 expref: 8 pid: 8192 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.688530:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022926216/0x7a8dd0fcbb925577 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa356 expref: 8 pid: 8192 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.688547:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789438271.688551:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789438271.688557:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001a33d9fe/0x7a8dd0fcbb92559a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.688586:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a33d9fe/0x7a8dd0fcbb92559a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.688620:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789438271.688680:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f41cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+7:2354:x1876361749783424:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 224us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438271.688688:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 56 00010000:00010000:3.0:1789438271.689265:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001a33d9fe/0x7a8dd0fcbb92559a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.689276:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a33d9fe/0x7a8dd0fcbb92559a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.689300:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001a33d9fe/0x7a8dd0fcbb92559a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.689308:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a33d9fe/0x7a8dd0fcbb92559a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.689316:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a33d9fe/0x7a8dd0fcbb92559a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.689323:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63e00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:3.0:1789438271.689335:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a33d9fe/0x7a8dd0fcbb92559a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.689344:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a33d9fe/0x7a8dd0fcbb92559a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.689359:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a33d9fe/0x7a8dd0fcbb92559a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.689367:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a33d9fe/0x7a8dd0fcbb92559a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438271.689593:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+6:2356:x1876361749783296:12345-192.168.206.9@tcp:1:lhsmtool_posix.0 Request processed in 7171us (7374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438271.689601:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 45 00000100:00100000:3.0:1789438271.696622:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438271.696758:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749783680 00000100:00100000:0.0:1789438271.696768:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749783680 00000100:00100000:0.0:1789438271.696826:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 127 00000100:00100000:0.0:1789438271.696850:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f41cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+14:10552:x1876361749783680:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789438271.696928:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb9255a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.696947:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb9255a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.696959:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb9255a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.697204:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9255a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.697227:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92555b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa341 expref: 15 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.697236:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9255a8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.697273:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92555b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa341 expref: 15 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.697288:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92555b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa341 expref: 15 pid: 7624 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438271.697319:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d04b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876361769716736:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789438271.697397:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991ff88d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789438271.700563:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d04b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876361769716736:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438271.700594:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9255a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438271.701907:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438271.702149:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749783808 00000100:00100000:1.0:1789438271.702158:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749783808 00010000:00010000:1.0:1789438271.702199:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92555b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa341 expref: 16 pid: 7624 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438271.702262:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 57 00000100:00100000:1.0:1789438271.702272:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f41cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+16:2354:x1876361749783808:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789438271.702288:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438271.702295:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92555b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa341 expref: 16 pid: 7624 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.702307:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92555b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa341 expref: 16 pid: 7624 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.702327:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb92555b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa341 expref: 16 pid: 7624 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.702342:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9991d5872600) 00010000:00010000:1.0:1789438271.702347:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9255a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.702356:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9255a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.702363:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9255a8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.702396:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438271.702450:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f41cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+15:2354:x1876361749783808:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 179us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438271.702458:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 57 00010000:00010000:0.0:1789438271.702582:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9255a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.702591:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9255a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789438271.702825:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1789438271.702978:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1789438271.703041:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1789438271.703143:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d04b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5838:1876361769716864:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789438271.703195:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438271.703224:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991ff88d000 going to sleep for 11 seconds 00000100:00100000:1.0:1789438271.704567:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769716864 00000100:00100000:1.0:1789438271.704594:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769716864 00000100:00100000:1.0:1789438271.704654:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789438271.704664:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5838:x1876361769716864:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789438271.704782:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5838:x1876361769716864:12345-0@lo:1000:mdt00_000.0 Request processed in 120us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438271.704790:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789438271.705015:0:5838:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1789438271.705033:0:5838:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:0.0:1789438271.705061:0:5838:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9991facb5500 x1876361769716096/t4294967309(4294967309) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789438287 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438271.705074:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d04b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5838:1876361769716864:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1789438271.705546:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1789438271.705615:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d04b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5838:1876361769716992:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789438271.705654:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438271.705693:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991ff88d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789438271.705940:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769716992 00000100:00100000:1.0:1789438271.705946:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769716992 00000100:00100000:1.0:1789438271.705986:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789438271.705994:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5838:x1876361769716992:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789438271.706222:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5838:x1876361769716992:12345-0@lo:1000:mdt00_000.0 Request processed in 229us (567us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789438271.706229:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789438271.706431:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d04b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5838:1876361769716992:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1789438271.706464:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9255a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.706473:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9255a8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.706480:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9255a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.706485:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438271.706490:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9255a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.706497:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9255a8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.706511:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9991d5872600) 00010000:00010000:0.0:1789438271.706514:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789438271.706518:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9255a8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.706524:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9255a8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.706553:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9254eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.706561:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9254eb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.706566:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9254eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.706579:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9da200 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438271.706583:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9254eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.706590:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9254eb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.706599:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991c3ac2000) 00010000:00010000:0.0:1789438271.706602:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789438271.706609:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb9254f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa325 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.706620:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb9254f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa325 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.706629:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb9254f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa325 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.706658:0:5838:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb9254f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa325 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438271.706671:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c7db6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876361769717120:192.168.206.9@tcp:105: 00000100:00100000:0.0:1789438271.706763:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991ff88d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789438271.710950:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438271.711040:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749783936 00000100:00100000:1.0:1789438271.711050:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749783936 00000100:00100000:1.0:1789438271.711114:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 31 00000100:00100000:1.0:1789438271.711124:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+19:10551:x1876361749783936:12345-192.168.206.9@tcp:49:lfs.0 00000100:00100000:1.0:1789438271.711248:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+19:10551:x1876361749783936:12345-192.168.206.9@tcp:49:lfs.0 Request processed in 125us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438271.711255:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 31 00000100:00100000:0.0:1789438271.711473:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c7db6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876361769717120:192.168.206.9@tcp:105: 00010000:00010000:0.0:1789438271.711501:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9254eb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.711529:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9254eb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.711562:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9255af lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.711577:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9255af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.711587:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9255af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.711597:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9255af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.711603:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9255af lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.711610:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9255af lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.711616:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438271.711620:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9255af lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.711627:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9255af lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.711638:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991c3ac2000) 00010000:00010000:0.0:1789438271.711641:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438271.711644:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9255af lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.711657:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9255af lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.711670:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb9255a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.711676:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb9255a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.711683:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb9255a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.711687:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63200 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438271.711691:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb9255a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.711696:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb9255a1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.711703:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991c3ac2000) 00010000:00010000:0.0:1789438271.711744:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789438271.711748:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb9255a1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.711754:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb9255a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438271.712124:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f41cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+18:10552:x1876361749783680:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 15286us (15508us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1789438271.712133:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 127 00000020:00080000:0.0:1789438271.712142:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789438271.712298:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789438271.712303:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789438271.713062:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789438271.713073:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789438271.716299:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438271.716336:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438271.716392:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749784192 00000100:00100000:3.0:1789438271.716401:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749784192 00000100:00100000:3.0:1789438271.716450:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 128 00000100:00100000:3.0:1789438271.716458:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+18:10551:x1876361749784192:12345-192.168.206.9@tcp:58:lfs.0 00000040:00080000:3.0:1789438271.716808:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1789438271.716931:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749784448 00000100:00100000:0.0:1789438271.716936:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749784448 00000100:00100000:0.0:1789438271.716966:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 32 00000100:00100000:0.0:1789438271.716973:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d21ba850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+19:10552:x1876361749784448:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789438271.717429:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789438271.717519:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1789438271.717559:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb9255b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.717575:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb9255b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.717587:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb9255b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.717596:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb9255b6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.717602:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb9255b6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.717609:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb9255b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438271.717630:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789438271.718084:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+21:10551:x1876361749784192:12345-192.168.206.9@tcp:58:lfs.0 Request processed in 1622us (1789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438271.718105:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 128 00000100:00100000:0.0:1789438271.718232:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d21ba850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+20:10552:x1876361749784448:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 Request processed in 1258us (1894us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1789438271.718240:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 32 00000020:00080000:0.0:1789438271.718243:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789438271.724803:0:11648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789438271.724817:0:11648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb9255b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.724828:0:11648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63a00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:2.0:1789438271.724832:0:11648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb9255b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.724859:0:11648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb9255b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.724878:0:11648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9991c3ac2200) 00010000:00010000:2.0:1789438271.724882:0:11648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789438271.724886:0:11648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb9255b6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.724892:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb9255b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.724936:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438271.724938:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438271.724940:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438271.748396:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438271.748501:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749784576 00000100:00100000:3.0:1789438271.748513:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749784576 00000100:00100000:3.0:1789438271.748609:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 129 00000100:00100000:3.0:1789438271.748621:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+20:10554:x1876361749784576:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:3.0:1789438271.748644:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438271.748663:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb9255bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa35d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.748761:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb9255c4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.748775:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb9255c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.748788:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb9255c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.748801:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb9255cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.748807:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb9255cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438271.748813:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb9255cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.749286:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb9255d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.749299:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb9254dd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa31e expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.749308:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb9255d2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.749345:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb9254dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa31e expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.749361:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb9254dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa31e expref: 21 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438271.749374:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3121c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876361769717248:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789438271.749460:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e7550600 going to sleep for 11 seconds 00000100:00100000:0.0:1789438271.753546:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3121c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876361769717248:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438271.753593:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb9255d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438271.759003:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438271.759153:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749784832 00000100:00100000:0.0:1789438271.759164:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749784832 00000100:00100000:0.0:1789438271.759227:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 33 00000100:00100000:0.0:1789438271.759238:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+22:5592:x1876361749784832:12345-192.168.206.9@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789438271.759472:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+23:5592:x1876361749784832:12345-192.168.206.9@tcp:35:ldlm_bl.0 Request processed in 235us (477us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1789438271.759479:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 33 00000100:00100000:2.0:1789438271.762101:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438271.762254:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749784960 00000100:00100000:1.0:1789438271.762264:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749784960 00010000:00010000:1.0:1789438271.762309:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb9254dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa31e expref: 23 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438271.762376:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 58 00000100:00100000:1.0:1789438271.762386:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3121180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+23:2353:x1876361749784960:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789438271.762402:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438271.762409:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb9254dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa31e expref: 23 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.762421:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb9254dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa31e expref: 23 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.762444:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb9254dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa31e expref: 23 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.762462:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991c3ac2000) 00010000:00010000:1.0:1789438271.762467:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb9255d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.762476:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb9255d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.762485:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb9255d2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438271.762520:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438271.762579:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3121180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+22:2353:x1876361749784960:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 194us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438271.762586:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 58 00010000:00010000:2.0:1789438271.762702:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb9255d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.762751:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb9255d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438271.762806:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789438271.762811:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789438271.762831:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb9255d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.762845:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb9255d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.762855:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb9255c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.762862:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb9255c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.762870:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb9255c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.762876:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438271.762880:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb9255c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.762889:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb9255c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.762899:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:2.0:1789438271.762902:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438271.762907:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb9255c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.762913:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb9255c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.762937:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb9255cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.762944:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb9255cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.762950:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb9255cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.762955:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55e00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438271.762958:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb9255cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.762965:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb9255cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.762973:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9991d192ce00) 00010000:00010000:2.0:1789438271.762975:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438271.762978:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb9255cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.762984:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb9255cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.763035:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb9255bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa35d expref: 22 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.763050:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb9255d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa35d expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438271.763071:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991c3ac2000) 00010000:00010000:2.0:1789438271.763074:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789438271.763077:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f0e00, rc 0) 00000100:00100000:2.0:1789438271.763118:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+21:10554:x1876361749784576:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 14500us (14731us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438271.763125:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 129 00000001:00080000:1.0:1789438272.369902:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1789438272.369925:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1789438272.370006:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00010000:00010000:2.0:1789438272.377834:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789438272.506358:0:12035:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789438272.506366:0:12035:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789438272.506410:0:12035:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789438272.506417:0:12035:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789438272.759275:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789438272.759285:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789438272.759342:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789438272.759349:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789438272.759626:0:11668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991facb4a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11668:1876361769717376:192.168.206.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789438272.759885:0:11668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fabaa600 going to sleep for 11 seconds 00000100:00100000:2.0:1789438272.771749:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438272.772249:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749785088 00000100:00100000:3.0:1789438272.772260:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749785088 00000100:00100000:3.0:1789438272.772335:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 130 00000100:00100000:3.0:1789438272.772362:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+22:10567:x1876361749785088:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789438272.772400:0:7624:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789438272.772505:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+22:10567:x1876361749785088:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 Request processed in 145us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438272.772513:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 130 00000100:00080000:2.0:1789438272.772674:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789438272.775465:0:11668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991facb4a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11668:1876361769717376:192.168.206.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789438272.776283:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438272.778426:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749785344 00000100:00100000:0.0:1789438272.778439:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749785344 00000100:00100000:0.0:1789438272.778576:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 131 00000100:00100000:0.0:1789438272.778588:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+21:10567:x1876361749785344:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789438272.778608:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438272.778630:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9255d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa364 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438272.778762:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9255e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438272.778778:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9255e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438272.778793:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9255e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438272.778807:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789438272.778947:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9255d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa364 expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438272.778970:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9255e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa364 expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438272.778977:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991c3ac2000) 00010000:00010000:0.0:1789438272.778980:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789438272.778983:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63400, rc 0) 00000100:00100000:0.0:1789438272.779044:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+23:10567:x1876361749785344:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 459us (2764us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1789438272.779052:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 131 00000100:00100000:3.0:1789438272.783629:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438272.783675:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438272.783786:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749785600 00000100:00100000:2.0:1789438272.783797:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749785600 00000100:00100000:2.0:1789438272.783849:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 132 00000100:00100000:2.0:1789438272.783858:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f41cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+23:10567:x1876361749785600:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789438272.783933:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb9255ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438272.783951:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb9255ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438272.783964:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb9255ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438272.784303:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749785728 00000100:00100000:1.0:1789438272.784309:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749785728 00010000:00010000:2.0:1789438272.784512:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb9255ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438272.784521:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb9255ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438272.784546:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb9255ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438272.784552:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0a00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438272.784557:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb9255ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438272.784565:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb9255ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438272.784577:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991c3ac2000) 00010000:00010000:2.0:1789438272.784580:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789438272.784585:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb9255ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438272.784591:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb9255ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438272.784776:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f41cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+25:10567:x1876361749785600:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 916us (1153us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1789438272.784785:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 132 00000100:00100000:1.0:1789438272.784911:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:1.0:1789438272.784921:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f41cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+24:2355:x1876361749785728:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789438272.785276:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438272.785295:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9255e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa364 expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438272.785308:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991c3ac2000) 00010000:00010000:2.0:1789438272.785312:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789438272.785348:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f41cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+23:2355:x1876361749785728:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 429us (1672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438272.785365:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 9 00000040:00080000:0.0:1789438272.786309:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789438272.786689:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1789438272.787959:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000040:00080000:0.0:1789438272.788033:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789438272.788042:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789438272.788632:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749785984 00000100:00100000:1.0:1789438272.788644:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749785984 00000100:00100000:1.0:1789438272.788791:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 34 00000100:00100000:1.0:1789438272.788802:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f41cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+23:10567:x1876361749785984:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789438272.789173:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f41cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+24:10567:x1876361749785984:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 Request processed in 372us (1218us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1789438272.789181:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 34 00010000:00010000:1.0:1789438273.398946:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438273.847535:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f41cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876361769717632:0@lo:400:kworker.0 00000100:00100000:1.0:1789438273.847608:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438273.847674:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff9e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769718144:0@lo:400:kworker.0 00000100:00100000:3.0:1789438273.847695:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769717632 00000100:00100000:3.0:1789438273.847703:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769717632 00000100:00100000:1.0:1789438273.847736:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438273.847764:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789438273.847768:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789438273.847770:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f41cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769717504:0@lo:400:kworker.0 00000100:00100000:3.0:1789438273.847778:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876361769717632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438273.847797:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438273.847818:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff9e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1876361769718016:0@lo:400:kworker.0 00000100:00100000:3.0:1789438273.847823:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876361769717632:12345-0@lo:400:kworker.0 Request processed in 47us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438273.847830:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789438273.847835:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438273.847846:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769718016 00000100:00100000:3.0:1789438273.847849:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769718016 00000100:00100000:1.0:1789438273.847865:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f41cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876361769717632:0@lo:400:kworker.0 00000100:00100000:3.0:1789438273.847871:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789438273.847876:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876361769718016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438273.847890:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f41ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769717888:0@lo:400:kworker.0 00000100:00100000:3.0:1789438273.847907:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876361769718016:12345-0@lo:400:kworker.0 Request processed in 31us (70us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438273.847911:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438273.847913:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789438273.847928:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789438273.847934:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f41cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876361769717760:0@lo:400:kworker.0 00000100:00100000:1.0:1789438273.847955:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438273.847975:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769718144 00000100:00100000:1.0:1789438273.847979:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769718144 00000100:00100000:1.0:1789438273.848008:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769717888 00000100:00100000:1.0:1789438273.848011:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769717888 00000100:00100000:1.0:1789438273.848033:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789438273.848039:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3312:x1876361769718144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438273.848071:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3312:x1876361769718144:12345-0@lo:400:kworker.0 Request processed in 32us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438273.848077:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789438273.848102:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789438273.848109:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769717888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438273.848139:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769717888:12345-0@lo:400:kworker.0 Request processed in 31us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438273.848146:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789438273.848174:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769717504 00000100:00100000:1.0:1789438273.848178:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769717504 00000100:00100000:1.0:1789438273.848201:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789438273.848207:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3312:x1876361769717504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438273.848237:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3312:x1876361769717504:12345-0@lo:400:kworker.0 Request processed in 30us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438273.848243:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789438273.848268:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769717760 00000100:00100000:1.0:1789438273.848272:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769717760 00000100:00100000:1.0:1789438273.848289:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789438273.848295:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876361769717760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438273.848543:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876361769717760:12345-0@lo:400:kworker.0 Request processed in 245us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438273.848550:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789438273.848593:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f41cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876361769717760:0@lo:400:kworker.0 00000100:00100000:1.0:1789438273.848602:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1789438273.848607:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:1.0:1789438273.848636:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9991f47d9180, transno 4294967301 00000004:00080000:1.0:1789438273.848647:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1789438273.848658:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9991d04b0700, transno 4294967304 00000100:00100000:1.0:1789438273.848662:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f41ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769717888:0@lo:400:kworker.0 00000100:00100000:1.0:1789438273.848930:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f41cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769717504:0@lo:400:kworker.0 00000100:00100000:1.0:1789438273.848942:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff9e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1876361769718016:0@lo:400:kworker.0 00000100:00100000:1.0:1789438273.848953:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff9e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769718144:0@lo:400:kworker.0 00000100:00080000:2.0:1789438273.849204:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789438273.849209:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789438273.849212:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1789438274.324223:0:12086:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789438274.324233:0:12086:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789438274.324279:0:12086:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789438274.324287:0:12086:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789438274.359380:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789438274.359412:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c31fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769718272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789438274.359483:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438274.360177:0:10069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769718272 00000100:00100000:3.0:1789438274.360186:0:10069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769718272 00000100:00100000:3.0:1789438274.360236:0:10069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789438274.360247:0:10069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff9e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769718272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789438274.360282:0:10069:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789438274.360335:0:10069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff9e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769718272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438274.360342:0:10069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789438274.361271:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c31fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769718272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789438274.373186:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c31f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769718400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789438274.373277:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438274.373500:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769718400 00000100:00100000:2.0:1789438274.373510:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769718400 00000100:00100000:2.0:1789438274.373564:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789438274.373579:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff9e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3310:x1876361769718400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789438274.373636:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789438274.373687:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff9e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3310:x1876361769718400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438274.373694:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789438274.373857:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c31f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769718400:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789438274.422833:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438274.496878:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438274.496942:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749786240 00000100:00100000:0.0:1789438274.496954:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749786240 00000100:00100000:0.0:1789438274.497100:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 133 00000100:00080000:1.0:1789438274.497108:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789438274.497115:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+24:10587:x1876361749786240:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:0.0:1789438274.497142:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438274.497164:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9255f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa36b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438274.497278:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9255fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438274.497293:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9255fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438274.497313:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9255fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438274.497337:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789438274.497466:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9255f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa36b expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438274.497486:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9255fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa36b expref: 26 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438274.497494:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991c3ac2000) 00010000:00010000:0.0:1789438274.497497:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789438274.497501:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d62600, rc 0) 00000100:00100000:0.0:1789438274.497567:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+26:10587:x1876361749786240:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 457us (697us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1789438274.497575:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 133 00000100:00100000:0.0:1789438274.501511:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438274.501974:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749786368 00000100:00100000:2.0:1789438274.501984:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749786368 00000100:00100000:2.0:1789438274.502042:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 134 00000100:00100000:2.0:1789438274.502051:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+26:10587:x1876361749786368:12345-192.168.206.9@tcp:54:lfs.0 00010000:00010000:2.0:1789438274.502123:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92560a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438274.502139:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92560a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438274.502151:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92560a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438274.502175:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92560a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438274.502185:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92560a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438274.502192:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92560a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438274.502198:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438274.502202:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92560a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438274.502209:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92560a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438274.502220:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991c3ac2000) 00010000:00010000:2.0:1789438274.502222:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789438274.502227:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92560a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438274.502234:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb92560a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438274.502310:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+26:10587:x1876361749786368:12345-192.168.206.9@tcp:54:lfs.0 Request processed in 259us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438274.502318:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 134 00000100:00100000:1.0:1789438274.607341:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438274.607413:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749786496 00000100:00100000:3.0:1789438274.607424:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749786496 00000100:00100000:3.0:1789438274.607498:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 46 00000100:00100000:3.0:1789438274.607510:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+6:2355:x1876361749786496:12345-192.168.206.9@tcp:101:cat.0 00010000:00010000:3.0:1789438274.607527:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438274.607546:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb3a785b/0x7a8dd0fcbb925611 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa372 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789438274.607569:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa8a93e, atime: 0x6aa8a93e, ctime: 0x6aa8a93e, blocks: 0xb 00010000:00010000:3.0:1789438274.607598:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=326s v=(0 0) 00010000:00010000:3.0:1789438274.607602:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438274.607610:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb3a785b/0x7a8dd0fcbb925611 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa372 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438274.607647:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eb3a785b/0x7a8dd0fcbb925611 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa372 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438274.607660:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a54600, rc 0) 00000100:00100000:3.0:1789438274.608144:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+7:2355:x1876361749786496:12345-192.168.206.9@tcp:101:cat.0 Request processed in 634us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438274.608151:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 46 00000100:00080000:1.0:1789438274.608443:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789438274.616952:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438274.617222:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749786624 00000100:00100000:3.0:1789438274.617234:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749786624 00002000:00100000:3.0:1789438274.617288:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9991facb4e00 x1876361749786624/t0(0) o3->1274be99-2d57-4dac-a13e-a89426512ee0@192.168.206.9@tcp:705/0 lens 488/0 e 0 to 0 dl 1789438285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789438274.617299:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9991facb4e00 with x1876361749786624 ext(0->4095) 00002000:00010000:3.0:1789438274.617305:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9991facb4e00 00000100:00100000:3.0:1789438274.617330:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 3 00000100:00100000:3.0:1789438274.617340:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1274be99-2d57-4dac-a13e-a89426512ee0+7:2356:x1876361749786624:12345-192.168.206.9@tcp:3:cat.0 00000100:00100000:3.0:1789438274.617564:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1274be99-2d57-4dac-a13e-a89426512ee0+7:2356:x1876361749786624:12345-192.168.206.9@tcp:3:cat.0 Request processed in 225us (621us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789438274.617572:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 3 00002000:00100000:3.0:1789438274.617580:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9991facb4e00 x1876361749786624/t0(0) o3->1274be99-2d57-4dac-a13e-a89426512ee0@192.168.206.9@tcp:705/0 lens 488/4536 e 0 to 0 dl 1789438285 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789438274.617588:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9991facb4e00 with x1876361749786624 ext(0->4095) 00002000:00010000:3.0:1789438274.617591:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9991facb4e00 00010000:00010000:2.0:1789438275.447887:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438276.071900:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438276.071980:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438276.072027:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438276.072045:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438276.072085:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438276.072131:0:11995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749787008 00000100:00100000:2.0:1789438276.072140:0:11995:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749787008 00000100:00100000:2.0:1789438276.072210:0:11995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749787136 00000100:00100000:2.0:1789438276.072213:0:11995:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749787136 00000100:00100000:2.0:1789438276.072240:0:11995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 76 00000100:00100000:2.0:1789438276.072250:0:11995:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c31f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1274be99-2d57-4dac-a13e-a89426512ee0+5:2356:x1876361749787008:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789438276.072318:0:11995:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c31f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1274be99-2d57-4dac-a13e-a89426512ee0+5:2356:x1876361749787008:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 69us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438276.072326:0:11995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 76 00000100:00100000:2.0:1789438276.072345:0:11995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 77 00000100:00100000:2.0:1789438276.072351:0:11995:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c31fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1274be99-2d57-4dac-a13e-a89426512ee0+7:2356:x1876361749787136:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789438276.072377:0:11995:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c31fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1274be99-2d57-4dac-a13e-a89426512ee0+7:2356:x1876361749787136:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 25us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438276.072382:0:11995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 77 00000100:00080000:2.0:1789438276.072398:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789438276.072402:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789438276.074242:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749787264 00000100:00100000:3.0:1789438276.074260:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749787264 00000100:00100000:3.0:1789438276.074341:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749786880 00000100:00100000:3.0:1789438276.074345:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749786880 00000100:00100000:3.0:1789438276.074372:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 136 00000100:00100000:3.0:1789438276.074380:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c31f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2356:x1876361749787264:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438276.074445:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c31f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2356:x1876361749787264:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 66us (2417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438276.074452:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 136 00000100:00100000:3.0:1789438276.074467:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 137 00000100:00100000:3.0:1789438276.074473:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c31f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+26:2356:x1876361749786880:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438276.074493:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c31f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+26:2356:x1876361749786880:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 21us (2448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438276.074499:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 137 00000100:00100000:0.0:1789438276.079277:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749786752 00000100:00100000:0.0:1789438276.079291:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749786752 00000100:00100000:0.0:1789438276.079359:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 285 00000100:00100000:0.0:1789438276.079371:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+13:2356:x1876361749786752:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789438276.079446:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+13:2356:x1876361749786752:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 78us (7557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438276.079453:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 285 00000100:00080000:3.0:1789438276.081119:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789438276.471874:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789438277.034388:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:3.0:1789438277.034405:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1789438277.035895:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1789438277.035924:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9991ff88d000 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1789438277.035929:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9991f3d34900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9991ff88d240 00000020:00080000:1.0:1789438277.035933:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9991f3d34500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9991f1110400 00000020:00080000:1.0:1789438277.035967:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1789438277.035992:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1789438277.037345:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1789438277.496009:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438278.519194:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438278.967992:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876361769718656:0@lo:400:kworker.0 00000100:00100000:3.0:1789438278.968082:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438278.968131:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f438d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769719168:0@lo:400:kworker.0 00000100:00100000:3.0:1789438278.968155:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438278.968182:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789438278.968188:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa7cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769718528:0@lo:400:kworker.0 00000100:00100000:3.0:1789438278.968215:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438278.968237:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f438c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1876361769719040:0@lo:400:kworker.0 00000100:00100000:3.0:1789438278.968256:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438278.968291:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f438f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769718784:0@lo:400:kworker.0 00000100:00100000:3.0:1789438278.968327:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438278.968349:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789438278.968355:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f438df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769718912:0@lo:400:kworker.0 00000100:00100000:3.0:1789438278.968377:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438278.968407:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769718656 00000100:00100000:3.0:1789438278.968415:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769718656 00000100:00100000:3.0:1789438278.968457:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769719040 00000100:00100000:3.0:1789438278.968460:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769719040 00000100:00100000:3.0:1789438278.968480:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769718784 00000100:00100000:3.0:1789438278.968483:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769718784 00000100:00100000:3.0:1789438278.968498:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789438278.968506:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876361769718656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438278.968555:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876361769718656:12345-0@lo:400:kworker.0 Request processed in 49us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438278.968562:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789438278.968581:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789438278.968587:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876361769719040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438278.968613:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876361769719040:12345-0@lo:400:kworker.0 Request processed in 27us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438278.968618:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789438278.968630:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789438278.968637:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769718784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438278.968668:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769718784:12345-0@lo:400:kworker.0 Request processed in 33us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438278.968674:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789438278.968690:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769719168 00000100:00100000:3.0:1789438278.968699:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769719168 00000100:00100000:3.0:1789438278.968754:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769718912 00000100:00100000:3.0:1789438278.968757:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769718912 00000100:00100000:3.0:1789438278.968776:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789438278.968783:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769719168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438278.968812:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769719168:12345-0@lo:400:kworker.0 Request processed in 30us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438278.968819:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789438278.968829:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789438278.968836:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769718912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438278.968862:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769718912:12345-0@lo:400:kworker.0 Request processed in 27us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438278.968867:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789438278.968883:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769718528 00000100:00100000:3.0:1789438278.968886:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769718528 00000100:00100000:3.0:1789438278.968910:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789438278.968916:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3312:x1876361769718528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438278.968944:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3312:x1876361769718528:12345-0@lo:400:kworker.0 Request processed in 28us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438278.968950:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:3.0:1789438278.968985:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789438278.968989:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789438278.968992:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789438278.969030:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f438df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769718912:0@lo:400:kworker.0 00000100:00100000:3.0:1789438278.969040:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f438f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769718784:0@lo:400:kworker.0 00000100:00100000:3.0:1789438278.969081:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa7cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769718528:0@lo:400:kworker.0 00000100:00100000:3.0:1789438278.969101:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f438c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1876361769719040:0@lo:400:kworker.0 00000100:00100000:3.0:1789438278.969110:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876361769718656:0@lo:400:kworker.0 00000100:00100000:3.0:1789438278.969119:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1789438278.969124:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9991facb5500, transno 4294967309 00000004:00080000:3.0:1789438278.969134:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9991facb6a00, transno 4294967310 00000004:00080000:3.0:1789438278.969139:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1789438278.969152:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f438d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769719168:0@lo:400:kworker.0 00000100:00100000:2.0:1789438279.195463:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438279.195553:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749787392 00000100:00100000:3.0:1789438279.195565:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749787392 00000100:00100000:3.0:1789438279.195646:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 135 00000100:00100000:3.0:1789438279.195659:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c31f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+13:10240:x1876361749787392:12345-192.168.206.9@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789438279.195784:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c31f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+13:10240:x1876361749787392:12345-192.168.206.9@tcp:60:lhsmtool_posix.0 Request processed in 128us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438279.195793:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 135 00000100:00080000:0.0:1789438279.196173:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789438279.200849:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438279.201033:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749787648 00000100:00100000:1.0:1789438279.201045:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749787648 00000100:00100000:1.0:1789438279.201118:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 35 00000100:00100000:1.0:1789438279.201128:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+13:10240:x1876361749787648:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789438279.201492:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+14:10240:x1876361749787648:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 Request processed in 363us (649us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1789438279.201500:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 35 00000100:00100000:0.0:1789438279.479080:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789438279.479282:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789438279.479305:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991facb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769719424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789438279.479377:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438279.482462:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769719424 00000100:00100000:2.0:1789438279.482479:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769719424 00000100:00100000:2.0:1789438279.482564:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789438279.482577:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff937b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769719424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789438279.482620:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789438279.482705:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff937b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769719424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (3327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438279.482742:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789438279.482885:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991facb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769719424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789438279.489640:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c31f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769719296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789438279.489751:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438279.489856:0:10069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769719296 00000100:00100000:3.0:1789438279.489866:0:10069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769719296 00000100:00100000:3.0:1789438279.489913:0:10069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789438279.489923:0:10069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769719296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789438279.489961:0:10069:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789438279.490028:0:10069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769719296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438279.490050:0:10069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789438279.490359:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c31f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769719296:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789438279.543432:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438280.567893:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789438281.015080:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789438281.015089:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789438281.015519:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1789438281.015527:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789438281.186264:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438281.186324:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438281.186448:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749788032 00000100:00100000:0.0:1789438281.186458:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749788032 00000100:00100000:0.0:1789438281.186529:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 80 00000100:00100000:0.0:1789438281.186541:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff935c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+5:2354:x1876361749788032:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789438281.186628:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff935c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+5:2354:x1876361749788032:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 89us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438281.186636:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 80 00000100:00100000:1.0:1789438281.186677:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749787776 00000100:00100000:1.0:1789438281.186683:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749787776 00000100:00100000:1.0:1789438281.186740:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 287 00000100:00100000:1.0:1789438281.186750:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+13:2354:x1876361749787776:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438281.186784:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+13:2354:x1876361749787776:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 36us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438281.186804:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 287 00000100:00080000:3.0:1789438281.187163:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789438281.187380:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438281.187408:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438281.187442:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438281.187526:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749788288 00000100:00100000:3.0:1789438281.187531:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749788288 00000100:00100000:0.0:1789438281.187594:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749787904 00000100:00100000:0.0:1789438281.187600:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749787904 00000100:00100000:3.0:1789438281.187659:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 141 00000100:00100000:3.0:1789438281.187667:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2354:x1876361749788288:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438281.187732:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2354:x1876361749788288:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 65us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438281.187739:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 141 00000100:00100000:3.0:1789438281.187759:0:11995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749788160 00000100:00100000:3.0:1789438281.187762:0:11995:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749788160 00000100:00080000:1.0:1789438281.191428:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789438281.191439:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789438281.192073:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 142 00000100:00100000:0.0:1789438281.192087:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+14:2354:x1876361749787904:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789438281.192173:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+14:2354:x1876361749787904:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 90us (4762us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438281.192181:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 142 00000100:00100000:3.0:1789438281.192301:0:11995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 81 00000100:00100000:3.0:1789438281.192311:0:11995:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1274be99-2d57-4dac-a13e-a89426512ee0+6:2354:x1876361749788160:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438281.192345:0:11995:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1274be99-2d57-4dac-a13e-a89426512ee0+6:2354:x1876361749788160:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 36us (4901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438281.192351:0:11995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 81 00000001:02000400:0.0:1789438281.217682:0:12284:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 22:11:19 (1789438279) 00010000:00010000:2.0:1789438281.605132:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789438282.212176:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1789438282.212195:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1789438282.212260:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1789438282.212273:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1789438282.614937:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438282.843900:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438282.844007:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749788544 00000100:00100000:3.0:1789438282.844018:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749788544 00000100:00100000:3.0:1789438282.844091:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 136 00000100:00100000:3.0:1789438282.844102:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+13:11297:x1876361749788544:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789438282.844123:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438282.844144:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb925618 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa379 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438282.844235:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb92561f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438282.844250:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb92561f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438282.844263:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb92561f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438282.844278:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925626 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438282.844286:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925626 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438282.844293:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925626 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438282.844558:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb92562d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438282.844568:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb92562d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438282.844576:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb92562d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789438282.844586:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1789438282.844772:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb92561f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438282.844780:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb92561f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438282.844794:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb92561f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438282.844800:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438282.844803:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb92561f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438282.844811:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb92561f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438282.844823:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9991c7c83100) 00010000:00010000:3.0:1789438282.844827:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789438282.844831:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb92561f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438282.844840:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb92561f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438282.844856:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925626 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438282.844863:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925626 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438282.844870:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925626 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438282.844875:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55a00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438282.844879:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925626 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438282.844898:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925626 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438282.844909:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9991d192c100) 00010000:00010000:3.0:1789438282.844912:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789438282.844916:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925626 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438282.844923:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925626 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438282.845398:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb925618 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa379 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438282.845414:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb92562d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa379 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438282.845421:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9991d5872000) 00010000:00010000:3.0:1789438282.845423:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789438282.845425:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a55e00, rc 0) 00000100:00100000:3.0:1789438282.845498:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+15:11297:x1876361749788544:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 1397us (1608us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1789438282.845507:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 136 00000100:00100000:3.0:1789438282.854090:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438282.854250:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438282.854480:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749788800 00000100:00100000:2.0:1789438282.854491:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749788800 00000100:00100000:2.0:1789438282.854558:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:2.0:1789438282.854569:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d055e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1274be99-2d57-4dac-a13e-a89426512ee0+15:2355:x1876361749788800:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789438282.854584:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438282.854609:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55e00/0x7a8dd0fcbb92562d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa379 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438282.854631:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9991d5872000) 00010000:00010000:2.0:1789438282.854637:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789438282.854702:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d055e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1274be99-2d57-4dac-a13e-a89426512ee0+14:2355:x1876361749788800:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 135us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438282.854741:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:0.0:1789438282.856161:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749788672 00000100:00100000:0.0:1789438282.856187:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749788672 00000100:00100000:0.0:1789438282.856244:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 137 00000100:00100000:0.0:1789438282.856256:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+14:11297:x1876361749788672:12345-192.168.206.9@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789438282.856974:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+14:11297:x1876361749788672:12345-192.168.206.9@tcp:59:lhsmtool_posix.0 Request processed in 717us (2889us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438282.856984:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 137 00000040:00080000:2.0:1789438283.064677:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789438283.064685:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789438283.064760:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1789438283.064768:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789438283.639271:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438284.087665:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f41cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769719936:0@lo:400:kworker.0 00000100:00100000:0.0:1789438284.087756:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769719808:0@lo:400:kworker.0 00000100:00100000:1.0:1789438284.087757:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438284.087837:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769719936 00000100:00100000:1.0:1789438284.087846:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769719936 00000100:00100000:1.0:1789438284.088211:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789438284.088228:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f41cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769719936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438284.088281:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f41cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769719936:12345-0@lo:400:kworker.0 Request processed in 61us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438284.088289:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1789438284.088317:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789438284.088351:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f41cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769719936:0@lo:400:kworker.0 00000100:00100000:3.0:1789438284.088419:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d04b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876361769719680:0@lo:400:kworker.0 00000100:00100000:2.0:1789438284.088464:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d04b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769719552:0@lo:400:kworker.0 00000100:00100000:0.0:1789438284.088464:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438284.088508:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438284.088537:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f41cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769720064:0@lo:400:kworker.0 00000100:00100000:2.0:1789438284.088560:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438284.088594:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769719808 00000100:00100000:2.0:1789438284.088598:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769719808 00000100:00100000:0.0:1789438284.088600:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769719552 00000100:00100000:0.0:1789438284.088606:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769719552 00000100:00100000:0.0:1789438284.088641:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789438284.088642:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769720064 00000100:00100000:0.0:1789438284.088648:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3311:x1876361769719552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438284.088655:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769720064 00000100:00100000:2.0:1789438284.088687:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789438284.088693:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3311:x1876361769719552:12345-0@lo:400:kworker.0 Request processed in 45us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438284.088698:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769719808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438284.088727:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1789438284.088749:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789438284.088760:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c31fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769720064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438284.088792:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c31fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769720064:12345-0@lo:400:kworker.0 Request processed in 35us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438284.088798:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789438284.088876:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438284.088982:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769719808:12345-0@lo:400:kworker.0 Request processed in 288us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438284.088988:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789438284.089057:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769719808:0@lo:400:kworker.0 00000100:00100000:3.0:1789438284.089462:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f41cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769720192:0@lo:400:kworker.0 00000100:00100000:3.0:1789438284.089489:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438284.089570:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769720192 00000100:00100000:0.0:1789438284.089575:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769720192 00000100:00100000:0.0:1789438284.089649:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789438284.089657:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff936680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769720192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438284.089694:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff936680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769720192:12345-0@lo:400:kworker.0 Request processed in 39us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438284.089700:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789438284.089818:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f41cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769720192:0@lo:400:kworker.0 00000100:00100000:2.0:1789438284.090123:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769719680 00000100:00100000:2.0:1789438284.090128:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769719680 00000100:00100000:2.0:1789438284.090150:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789438284.090156:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff935180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876361769719680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438284.090399:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff935180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876361769719680:12345-0@lo:400:kworker.0 Request processed in 242us (1521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438284.090406:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:2.0:1789438284.090433:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789438284.090438:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789438284.090455:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d04b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769719552:0@lo:400:kworker.0 00000100:00100000:2.0:1789438284.090467:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f41cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769720064:0@lo:400:kworker.0 00000100:00100000:3.0:1789438284.090548:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d04b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876361769719680:0@lo:400:kworker.0 00000100:00100000:1.0:1789438284.600468:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789438284.600505:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f41cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769720320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789438284.600577:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438284.600643:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769720320 00000100:00100000:1.0:1789438284.600651:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769720320 00000100:00100000:1.0:1789438284.600700:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789438284.600730:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f41ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769720320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789438284.600765:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789438284.600811:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f41ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769720320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438284.600818:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789438284.600868:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f41cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769720320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789438284.603177:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789438284.603201:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c31fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769720448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789438284.603265:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438284.603310:0:10069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769720448 00000100:00100000:2.0:1789438284.603318:0:10069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769720448 00000100:00100000:2.0:1789438284.604819:0:10069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789438284.604835:0:10069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff935f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769720448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789438284.604875:0:10069:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789438284.604954:0:10069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff935f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769720448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (1689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438284.604961:0:10069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789438284.609161:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c31fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769720448:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789438284.668960:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438284.866460:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438284.866642:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749788928 00000100:00100000:3.0:1789438284.866653:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749788928 00000100:00100000:3.0:1789438284.866760:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 138 00000100:00100000:3.0:1789438284.866773:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f41cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+14:11339:x1876361749788928:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:3.0:1789438284.866792:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438284.866813:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb92563b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa380 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438284.867000:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925642 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438284.867015:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925642 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438284.867037:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925642 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438284.867054:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925649 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438284.867074:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925649 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438284.867081:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925649 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438284.867382:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925642 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438284.867390:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925642 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438284.867398:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925642 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438284.867404:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55a00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438284.867408:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925642 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438284.867417:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925642 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438284.867429:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991c3ac2e00) 00010000:00010000:3.0:1789438284.867432:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789438284.867437:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925642 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438284.867444:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925642 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438284.867455:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925649 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438284.867467:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925649 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438284.867473:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925649 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438284.867479:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438284.867482:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925649 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438284.867488:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925649 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438284.867497:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9991d192c100) 00010000:00010000:3.0:1789438284.867500:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789438284.867502:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925649 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438284.867508:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925649 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438284.867540:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb92563b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa380 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438284.867550:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991c3ac2e00) 00010000:00010000:3.0:1789438284.867552:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789438284.867556:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb92563b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa380 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438284.867564:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a55200, rc 0) 00000100:00100000:3.0:1789438284.867676:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f41cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+14:11339:x1876361749788928:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 906us (1225us total) trans 0 rc 301/301 00000100:00100000:3.0:1789438284.867685:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 138 00000100:00080000:2.0:1789438284.867928:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789438284.878277:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438284.881811:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749789184 00000100:00100000:2.0:1789438284.881827:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749789184 00000100:00100000:2.0:1789438284.881890:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 139 00000100:00100000:2.0:1789438284.881902:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f41cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+14:11339:x1876361749789184:12345-192.168.206.9@tcp:36:lfs.0 00010000:00010000:2.0:1789438284.881954:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438284.881995:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb924fc7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1c0 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438284.882011:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991c3ac2e00) 00010000:00010000:2.0:1789438284.882020:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789438284.882367:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925650 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438284.882381:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925650 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438284.882392:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925650 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438284.882405:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925657 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438284.882412:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925657 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438284.882418:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925657 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438284.883488:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789438284.883506:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925650 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438284.883514:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925650 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438284.883521:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925650 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438284.883527:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438284.883531:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925650 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438284.883539:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925650 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438284.883551:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:2.0:1789438284.883554:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438284.883558:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925650 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438284.883564:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925650 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789438284.883580:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004cda7690 reply state 00000000b9f54899 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925657 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438284.883587:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789438284.883781:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f41cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+15:11339:x1876361749789184:12345-192.168.206.9@tcp:36:lfs.0 Request processed in 1879us (5511us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1789438284.883790:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 139 00010000:00010000:1.0:1789438284.902514:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925657 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438284.902531:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925657 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438284.902539:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925657 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438284.902545:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0600 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438284.902550:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925657 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438284.902559:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925657 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438284.902586:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9991d5872a00) 00010000:00010000:1.0:1789438284.902589:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438284.902593:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925657 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438284.902599:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925657 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438285.002050:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438285.002282:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749789312 00000100:00100000:2.0:1789438285.002303:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749789312 00000100:00100000:2.0:1789438285.002366:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 140 00000100:00100000:2.0:1789438285.002377:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f41cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+14:11347:x1876361749789312:12345-192.168.206.9@tcp:101:lctl.0 00010000:00010000:2.0:1789438285.002400:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438285.002425:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb92565e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa387 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.002494:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb925665 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.002508:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb925665 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.002528:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb925665 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438285.002562:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789438285.002566:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789438285.002589:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb925665 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.002610:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb92565e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa387 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.002626:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb925665 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa387 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.002635:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:2.0:1789438285.002638:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789438285.002641:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f0400, rc 0) 00000100:00100000:2.0:1789438285.002747:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f41cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+15:11347:x1876361749789312:12345-192.168.206.9@tcp:101:lctl.0 Request processed in 371us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438285.002755:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 140 00000100:00100000:0.0:1789438285.108144:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438285.111530:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749789440 00000100:00100000:3.0:1789438285.111550:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749789440 00000100:00100000:3.0:1789438285.111679:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 141 00000100:00100000:3.0:1789438285.111691:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+15:11353:x1876361749789440:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:3.0:1789438285.111734:0:7624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438285.111755:0:7624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb92566c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa38e expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.111813:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925673 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.111839:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925673 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.111850:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925673 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.111876:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92567a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.111883:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92567a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.111891:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92567a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.112006:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb925681 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.112038:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb925681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.112046:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb925681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789438285.112078:0:7624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789438285.112082:0:7624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789438285.112102:0:7624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb925681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.112114:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925673 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.112121:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925673 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.112128:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925673 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.112133:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438285.112137:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925673 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.112146:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925673 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.112159:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:3.0:1789438285.112162:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789438285.112167:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925673 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.112182:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925673 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.112196:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92567a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.112203:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92567a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.112208:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92567a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.112212:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55a00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438285.112216:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92567a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.112222:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92567a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.112229:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9991d192c100) 00010000:00010000:3.0:1789438285.112232:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789438285.112234:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92567a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.112240:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92567a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.112273:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb92566c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa38e expref: 17 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.112285:0:7624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb925681 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa38e expref: 16 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.112298:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:3.0:1789438285.112300:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789438285.112302:0:7624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a55400, rc 0) 00000100:00100000:3.0:1789438285.112380:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+16:11353:x1876361749789440:12345-192.168.206.9@tcp:101:bash.0 Request processed in 690us (4244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438285.112387:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 141 00000100:00100000:0.0:1789438285.118219:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438285.118303:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749789696 00000100:00100000:2.0:1789438285.118314:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749789696 00000100:00100000:2.0:1789438285.118370:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 142 00000100:00100000:2.0:1789438285.118380:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+16:11353:x1876361749789696:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:2.0:1789438285.118401:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438285.118424:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925688 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa395 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.118547:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb92568f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.118561:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb92568f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.118572:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb92568f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.118629:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925696 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.118637:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925696 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.118643:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925696 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789438285.119786:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1789438285.120204:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92569d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.120225:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92569d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.120235:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92569d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.120273:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb92568f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.120280:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb92568f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.120287:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb92568f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.120293:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0a00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438285.120297:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb92568f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.120304:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb92568f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.120315:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:2.0:1789438285.120318:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438285.120323:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb92568f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.120330:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb92568f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789438285.120343:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000839d61d1 reply state 000000003cbf514e transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925696 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438285.120358:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789438285.120395:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925688 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa395 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.120411:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92569d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa395 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.120419:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872a00) 00010000:00010000:2.0:1789438285.120421:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789438285.120423:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f1800, rc 0) 00000100:00100000:2.0:1789438285.120565:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+19:11353:x1876361749789696:12345-192.168.206.9@tcp:101:bash.0 Request processed in 2185us (2353us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1789438285.120574:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 142 00000100:00100000:0.0:1789438285.136256:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438285.136430:0:11995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749789824 00000100:00100000:3.0:1789438285.136441:0:11995:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749789824 00000100:00100000:3.0:1789438285.136523:0:11995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 47 00000100:00100000:3.0:1789438285.136536:0:11995:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa644700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1274be99-2d57-4dac-a13e-a89426512ee0+5:2353:x1876361749789824:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:3.0:1789438285.136554:0:11995:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438285.136576:0:11995:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000761ac94b/0x7a8dd0fcbb9256ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa39c expref: -99 pid: 11995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789438285.136605:0:11995:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789438285.136627:0:11995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=337s v=(0 0) 00010000:00010000:3.0:1789438285.136631:0:11995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438285.136642:0:11995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000761ac94b/0x7a8dd0fcbb9256ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa39c expref: 6 pid: 11995 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.136660:0:11995:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000761ac94b/0x7a8dd0fcbb9256ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa39c expref: 6 pid: 11995 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.136673:0:11995:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a55200, rc 0) 00000100:00100000:3.0:1789438285.136758:0:11995:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa644700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1274be99-2d57-4dac-a13e-a89426512ee0+6:2353:x1876361749789824:12345-192.168.206.9@tcp:101:bash.0 Request processed in 226us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438285.136773:0:11995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 47 00000100:00080000:1.0:1789438285.137093:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789438285.139575:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925696 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.139595:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925696 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.139605:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925696 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.139612:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438285.139618:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925696 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.139627:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925696 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.139672:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9991d5872700) 00010000:00010000:2.0:1789438285.139676:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438285.139682:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925696 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.139689:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925696 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438285.141467:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438285.141566:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749789952 00000100:00100000:0.0:1789438285.141577:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749789952 00000100:00100000:0.0:1789438285.141633:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 48 00000100:00100000:0.0:1789438285.141643:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f41cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+6:11353:x1876361749789952:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:0.0:1789438285.141660:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438285.141679:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc8e1a3/0x7a8dd0fcbb9256b2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa3a3 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.141729:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000761ac94b/0x7a8dd0fcbb9256ab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa39c expref: 7 pid: 11995 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.141740:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789438285.141744:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789438285.141750:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc8e1a3/0x7a8dd0fcbb9256b2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3a3 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.141785:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000761ac94b/0x7a8dd0fcbb9256ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa39c expref: 7 pid: 11995 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.141799:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000761ac94b/0x7a8dd0fcbb9256ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa39c expref: 7 pid: 11995 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438285.141813:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa647800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1876361769720576:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789438285.141913:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9990c1385900 going to sleep for 11 seconds 00000100:00100000:1.0:1789438285.146334:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa647800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1876361769720576:192.168.206.9@tcp:104: 00010000:00010000:1.0:1789438285.146376:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc8e1a3/0x7a8dd0fcbb9256b2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3a3 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.146398:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63200, rc 0) 00000100:00100000:1.0:1789438285.146479:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f41cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+7:11353:x1876361749789952:12345-192.168.206.9@tcp:101:bash.0 Request processed in 4836us (5020us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438285.146488:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 48 00000100:00100000:2.0:1789438285.159531:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438285.159649:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749790080 00000100:00100000:3.0:1789438285.159660:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749790080 00010000:00010000:3.0:1789438285.159747:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000761ac94b/0x7a8dd0fcbb9256ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa39c expref: 7 pid: 11995 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438285.159793:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 59 00000100:00100000:3.0:1789438285.159804:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c31fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+7:2353:x1876361749790080:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789438285.159820:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438285.159852:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000761ac94b/0x7a8dd0fcbb9256ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa39c expref: 7 pid: 11995 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.159867:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000761ac94b/0x7a8dd0fcbb9256ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa39c expref: 7 pid: 11995 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.159890:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000761ac94b/0x7a8dd0fcbb9256ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa39c expref: 7 pid: 11995 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.159906:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438285.159910:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438285.159918:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc8e1a3/0x7a8dd0fcbb9256b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3a3 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.159928:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc8e1a3/0x7a8dd0fcbb9256b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3a3 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.160139:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000cc8e1a3/0x7a8dd0fcbb9256b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3a3 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438285.160164:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff934700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5824:1876361769720704:192.168.206.9@tcp:105: 00000100:00100000:3.0:1789438285.160236:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c4e6c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789438285.171229:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438285.171586:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749790336 00000100:00100000:1.0:1789438285.171596:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749790336 00000100:00100000:1.0:1789438285.171657:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 36 00000100:00100000:1.0:1789438285.171668:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+18:11353:x1876361749790336:12345-192.168.206.9@tcp:35:bash.0 00000100:00100000:1.0:1789438285.172075:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+19:11353:x1876361749790336:12345-192.168.206.9@tcp:35:bash.0 Request processed in 407us (853us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1789438285.172083:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 36 00000100:00100000:3.0:1789438285.176391:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff934700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5824:1876361769720704:192.168.206.9@tcp:105: 00010000:00010000:3.0:1789438285.176428:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789438285.177464:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c31fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+6:2353:x1876361749790080:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 17656us (17937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438285.177487:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 59 00000100:00100000:0.0:1789438285.314611:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438285.314764:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749790592 00000100:00100000:2.0:1789438285.314775:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749790592 00000100:00100000:2.0:1789438285.314846:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 143 00000100:00100000:2.0:1789438285.314857:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+19:11363:x1876361749790592:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789438285.314881:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438285.314902:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb9256b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa3aa expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438285.314998:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789438285.315126:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb9256b9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3aa expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.315140:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:2.0:1789438285.315143:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789438285.315148:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb9256b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3aa expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.315162:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f0a00, rc 0) 00000100:00100000:2.0:1789438285.315226:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+20:11363:x1876361749790592:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 370us (622us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1789438285.315241:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 143 00000100:00100000:0.0:1789438285.318233:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438285.318334:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749790848 00000100:00100000:1.0:1789438285.318344:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749790848 00000100:00100000:1.0:1789438285.318404:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 37 00000100:00100000:1.0:1789438285.318415:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d05d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+20:11363:x1876361749790848:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:1.0:1789438285.318659:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d05d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+21:11363:x1876361749790848:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 245us (434us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1789438285.318668:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 37 00000100:00100000:1.0:1789438285.407639:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438285.407783:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749790976 00000100:00100000:3.0:1789438285.407793:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749790976 00000100:00100000:3.0:1789438285.407931:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 144 00000100:00100000:3.0:1789438285.407943:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f41cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+21:11369:x1876361749790976:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:3.0:1789438285.407974:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438285.407993:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb9256c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa3b1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.408066:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb9256ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.408080:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb9256ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.408092:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb9256ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789438285.408137:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789438285.408140:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789438285.408166:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb9256ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.408190:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb9256c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3b1 expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.408210:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb9256ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3b1 expref: 22 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.408218:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:3.0:1789438285.408221:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789438285.408225:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a55a00, rc 0) 00000100:00100000:3.0:1789438285.408283:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f41cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+22:11369:x1876361749790976:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 342us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438285.408289:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 144 00000100:00100000:0.0:1789438285.412750:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438285.412994:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749791232 00000100:00100000:1.0:1789438285.413005:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749791232 00000100:00100000:1.0:1789438285.413073:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 145 00000100:00100000:1.0:1789438285.413083:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d05d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+22:11369:x1876361749791232:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438285.413105:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438285.413126:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb9256d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa3b8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.413236:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9256dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.413252:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9256dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.413264:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9256dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438285.413275:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789438285.413400:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb9256d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3b8 expref: 25 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.413437:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9256dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3b8 expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.413445:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872a00) 00010000:00010000:1.0:1789438285.413448:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789438285.413452:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9da600, rc 0) 00000100:00100000:1.0:1789438285.413514:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d05d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+24:11369:x1876361749791232:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 432us (816us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1789438285.413522:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 145 00000100:00100000:0.0:1789438285.416312:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438285.416567:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749791488 00000100:00100000:1.0:1789438285.416577:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749791488 00000100:00100000:1.0:1789438285.416631:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 146 00000100:00100000:1.0:1789438285.416641:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d05d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+24:11369:x1876361749791488:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438285.416671:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438285.416689:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9256ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa3bf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.416800:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb9256f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.416813:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb9256f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.416824:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb9256f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438285.416836:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789438285.417097:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9256ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3bf expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.417121:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb9256f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3bf expref: 26 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.417129:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872a00) 00010000:00010000:1.0:1789438285.417132:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789438285.417135:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9db400, rc 0) 00000100:00100000:1.0:1789438285.417207:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d05d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+26:11369:x1876361749791488:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 567us (905us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1789438285.417214:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 146 00000100:00100000:3.0:1789438285.419428:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438285.419558:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749791616 00000100:00100000:2.0:1789438285.419568:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749791616 00000100:00100000:2.0:1789438285.419627:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 11 00000100:00100000:2.0:1789438285.419638:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff934700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1274be99-2d57-4dac-a13e-a89426512ee0+26:2356:x1876361749791616:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789438285.419653:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438285.419895:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9256dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3b8 expref: 26 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.419915:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872a00) 00010000:00010000:2.0:1789438285.419920:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789438285.419983:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff934700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1274be99-2d57-4dac-a13e-a89426512ee0+25:2356:x1876361749791616:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 347us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438285.419991:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 11 00000100:00100000:0.0:1789438285.425409:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438285.425495:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749791744 00000100:00100000:3.0:1789438285.425505:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749791744 00000100:00100000:3.0:1789438285.425564:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 49 00000100:00100000:3.0:1789438285.425573:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d05d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+6:2353:x1876361749791744:12345-192.168.206.9@tcp:1:lfs.0 00010000:00010000:3.0:1789438285.425617:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000761ac94b/0x7a8dd0fcbb9256ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.425635:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc8e1a3/0x7a8dd0fcbb9256b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3a3 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.425676:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438285.425681:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789438285.425686:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000761ac94b/0x7a8dd0fcbb9256ff lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.425761:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000cc8e1a3/0x7a8dd0fcbb9256b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3a3 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.425775:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000cc8e1a3/0x7a8dd0fcbb9256b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3a3 expref: 6 pid: 6682 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438285.425790:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff936d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876361769720832:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789438285.425879:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c4e6c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789438285.429003:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438285.429111:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749791872 00000100:00100000:1.0:1789438285.429121:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749791872 00002000:00100000:1.0:1789438285.429180:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9991d05d4e00 x1876361749791872/t0(0) o4->1274be99-2d57-4dac-a13e-a89426512ee0@192.168.206.9@tcp:716/0 lens 504/0 e 0 to 0 dl 1789438296 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789438285.429192:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9991d05d4e00 with x1876361749791872 ext(0->12) 00010000:00010000:1.0:1789438285.429201:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000cc8e1a3/0x7a8dd0fcbb9256b2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3a3 expref: 7 pid: 6682 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.429217:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000cc8e1a3/0x7a8dd0fcbb9256b2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3a3 expref: 7 pid: 6682 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789438285.429225:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9991d05d4e00 00000100:00100000:1.0:1789438285.429256:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 2 00000100:00100000:1.0:1789438285.429266:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d05d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1274be99-2d57-4dac-a13e-a89426512ee0+7:2354:x1876361749791872:12345-192.168.206.9@tcp:4:lfs.0 00000100:00100000:1.0:1789438285.429981:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d05d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1274be99-2d57-4dac-a13e-a89426512ee0+9:2354:x1876361749791872:12345-192.168.206.9@tcp:4:lfs.0 Request processed in 713us (983us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789438285.429996:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 2 00002000:00100000:1.0:1789438285.430003:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9991d05d4e00 x1876361749791872/t4294967305(0) o4->1274be99-2d57-4dac-a13e-a89426512ee0@192.168.206.9@tcp:716/0 lens 504/448 e 0 to 0 dl 1789438296 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789438285.430012:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9991d05d4e00 with x1876361749791872 ext(0->12) 00010000:00010000:1.0:1789438285.430019:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000cc8e1a3/0x7a8dd0fcbb9256b2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3a3 expref: 9 pid: 6682 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.430043:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000cc8e1a3/0x7a8dd0fcbb9256b2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3a3 expref: 9 pid: 6682 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789438285.430050:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9991d05d4e00 00000100:00100000:3.0:1789438285.430149:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff936d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876361769720832:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789438285.430176:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000761ac94b/0x7a8dd0fcbb9256ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438285.433342:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438285.433439:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749792000 00000100:00100000:3.0:1789438285.433449:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749792000 00010000:00010000:3.0:1789438285.433488:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000cc8e1a3/0x7a8dd0fcbb9256b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3a3 expref: 9 pid: 6682 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438285.433564:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 60 00000100:00100000:3.0:1789438285.433575:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff999201d38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+9:2353:x1876361749792000:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789438285.433599:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789438285.433619:0:5822:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789438285.433622:0:5822:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789438284 00002000:00010000:3.0:1789438285.433624:0:5822:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789438285 00002000:00010000:3.0:1789438285.433627:0:5822:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789438284 00010000:00010000:3.0:1789438285.433634:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000cc8e1a3/0x7a8dd0fcbb9256b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3a3 expref: 9 pid: 6682 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.433649:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000cc8e1a3/0x7a8dd0fcbb9256b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3a3 expref: 9 pid: 6682 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.433684:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc8e1a3/0x7a8dd0fcbb9256b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3a3 expref: 9 pid: 6682 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.433703:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789438285.433743:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789438285.433748:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000761ac94b/0x7a8dd0fcbb9256ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.433759:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000761ac94b/0x7a8dd0fcbb9256ff lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.433794:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789438285.433854:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff999201d38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+8:2353:x1876361749792000:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 280us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438285.433862:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 60 00010000:00010000:0.0:1789438285.433933:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000761ac94b/0x7a8dd0fcbb9256ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.433943:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000761ac94b/0x7a8dd0fcbb9256ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.433979:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000761ac94b/0x7a8dd0fcbb9256ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.433988:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000761ac94b/0x7a8dd0fcbb9256ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.433997:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000761ac94b/0x7a8dd0fcbb9256ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.434004:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55200 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:0.0:1789438285.434008:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000761ac94b/0x7a8dd0fcbb9256ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.434017:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000761ac94b/0x7a8dd0fcbb9256ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.434051:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000761ac94b/0x7a8dd0fcbb9256ff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.434059:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000761ac94b/0x7a8dd0fcbb9256ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438285.434106:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d05d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+7:2353:x1876361749791744:12345-192.168.206.9@tcp:1:lfs.0 Request processed in 8534us (8706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438285.434114:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 49 00000100:00100000:2.0:1789438285.436541:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438285.436631:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749792256 00000100:00100000:1.0:1789438285.436640:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749792256 00000100:00100000:1.0:1789438285.436931:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 38 00000100:00100000:1.0:1789438285.436942:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d21b9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+25:11369:x1876361749792256:12345-192.168.206.9@tcp:35:lfs.0 00000004:00010000:1.0:1789438285.437063:0:5842:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb9256f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3bf expref: 25 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789438285.437282:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1789438285.437324:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1789438285.438330:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1789438285.438395:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb925706 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.438413:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92569d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa395 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.438430:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb925706 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.438472:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92569d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa395 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.438489:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92569d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa395 expref: 29 pid: 5840 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438285.438504:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff999201d38380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5842:1876361769720960:192.168.206.9@tcp:104: 00000100:00100000:1.0:1789438285.438624:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991ff88d480 going to sleep for 11 seconds 00000100:00100000:1.0:1789438285.441374:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff999201d38380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5842:1876361769720960:192.168.206.9@tcp:104: 00010000:00010000:1.0:1789438285.441404:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb925706 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438285.443642:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438285.444213:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749792384 00000100:00100000:0.0:1789438285.444224:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749792384 00010000:00010000:0.0:1789438285.444269:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92569d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa395 expref: 30 pid: 5840 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438285.444353:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 61 00000100:00100000:0.0:1789438285.444364:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c31f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+30:2353:x1876361749792384:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789438285.444380:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438285.444386:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92569d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa395 expref: 30 pid: 5840 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.444400:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92569d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa395 expref: 30 pid: 5840 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.444424:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92569d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa395 expref: 30 pid: 5840 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.444460:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872a00) 00010000:00010000:0.0:1789438285.444465:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb925706 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.444474:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb925706 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.444481:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb925706 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.444513:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438285.444572:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c31f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+29:2353:x1876361749792384:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 210us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438285.444579:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 61 00010000:00010000:1.0:1789438285.445665:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb925706 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.445679:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb925706 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789438285.445854:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1789438285.446076:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1789438285.446219:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff999201d38380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1876361769721088:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789438285.446277:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438285.446301:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991ff88d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438285.446599:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769721088 00000100:00100000:3.0:1789438285.446607:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769721088 00000100:00100000:3.0:1789438285.446656:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789438285.446665:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff999201d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1876361769721088:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789438285.446779:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff999201d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1876361769721088:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 115us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438285.446787:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789438285.447143:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff999201d38380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1876361769721088:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789438285.447701:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1789438285.448306:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff999201d38380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1876361769721216:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789438285.448363:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438285.448439:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991ff88d480 going to sleep for 11 seconds 00000100:00100000:3.0:1789438285.453241:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769721216 00000100:00100000:3.0:1789438285.453261:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769721216 00000100:00100000:3.0:1789438285.453543:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789438285.453555:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff999201d39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1876361769721216:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789438285.453885:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff999201d39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5842:x1876361769721216:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 332us (5520us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789438285.453894:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789438285.454340:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff999201d38380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1876361769721216:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789438285.454417:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1789438285.454466:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb925706 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.454478:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb925706 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.454487:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb925706 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.454493:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dac00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438285.454497:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb925706 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.454505:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb925706 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.454520:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872a00) 00010000:00010000:1.0:1789438285.454523:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789438285.454528:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb925706 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.454535:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb925706 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789438285.454747:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789438285.454906:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1789438285.454916:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 337720207943ns, next at 338720206072ns, rc = 0 00000001:00080000:1.0:1789438285.454922:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1789438285.454966:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872a00) 00010000:00010000:1.0:1789438285.454970:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789438285.454977:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb9256f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3bf expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438285.455086:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d21b9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+32:11369:x1876361749792256:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 18145us (18552us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1789438285.455094:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 38 00000020:00080000:1.0:1789438285.455099:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789438285.458256:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438285.458350:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749792512 00000100:00100000:2.0:1789438285.458360:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749792512 00000100:00100000:2.0:1789438285.458440:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 147 00000100:00100000:2.0:1789438285.458452:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff999201d38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+32:11369:x1876361749792512:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789438285.458475:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438285.458497:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb92570d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa3c6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.458556:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb92570d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3c6 expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.458592:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb92570d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3c6 expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.458612:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872700) 00010000:00010000:2.0:1789438285.458615:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789438285.458619:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f1c00, rc 0) 00000100:00100000:2.0:1789438285.458692:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff999201d38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+33:11369:x1876361749792512:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 243us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438285.458699:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 147 00000100:00100000:3.0:1789438285.461481:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438285.461563:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749792768 00000100:00100000:1.0:1789438285.461573:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749792768 00000100:00100000:1.0:1789438285.461629:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 39 00000100:00100000:1.0:1789438285.461639:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+33:11369:x1876361749792768:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:1.0:1789438285.461911:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+34:11369:x1876361749792768:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 272us (438us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1789438285.461919:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 39 00000100:00100000:3.0:1789438285.542218:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438285.542429:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749793024 00000100:00100000:1.0:1789438285.542440:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749793024 00000100:00100000:1.0:1789438285.542508:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 148 00000100:00100000:1.0:1789438285.542519:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+34:11379:x1876361749793024:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438285.542543:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438285.542564:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb925714 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa3cd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438285.542674:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789438285.542833:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb925714 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3cd expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.542848:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:1.0:1789438285.542851:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789438285.542856:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb925714 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3cd expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.542871:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9db400, rc 0) 00000100:00100000:1.0:1789438285.542932:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+35:11379:x1876361749793024:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 415us (723us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1789438285.542939:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 148 00000100:00100000:1.0:1789438285.548368:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438285.548445:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749793152 00000100:00100000:0.0:1789438285.548456:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749793152 00000100:00100000:0.0:1789438285.548524:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 149 00000100:00100000:0.0:1789438285.548536:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff999201d39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+35:11379:x1876361749793152:12345-192.168.206.9@tcp:34:lfs.0 00010000:00010000:0.0:1789438285.548614:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925722 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.548632:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925722 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.548645:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925722 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.548673:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925729 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.548699:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.548874:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.548974:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925730 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.548984:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.548991:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789438285.549047:0:7624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.549061:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925722 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.549068:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925722 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.549076:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925722 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.549082:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63a00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438285.549086:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925722 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.549094:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925722 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.549112:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:0.0:1789438285.549115:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438285.549120:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925722 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.549126:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925722 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.549139:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.549146:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925729 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.549151:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925729 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.549157:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438285.549159:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925729 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.549166:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925729 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.549173:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9991c3ac2b00) 00010000:00010000:0.0:1789438285.549175:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438285.549178:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925729 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.549184:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925729 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.549209:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.549215:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925730 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.549226:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925730 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.549231:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438285.549234:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925730 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.549240:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925730 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.549247:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872700) 00010000:00010000:0.0:1789438285.549250:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438285.549252:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925730 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.549257:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925730 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438285.549337:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff999201d39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+35:11379:x1876361749793152:12345-192.168.206.9@tcp:34:lfs.0 Request processed in 802us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438285.549346:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 149 00000100:00100000:3.0:1789438285.554333:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438285.561910:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749793408 00000100:00100000:1.0:1789438285.561926:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749793408 00000100:00100000:1.0:1789438285.562010:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 40 00000100:00100000:1.0:1789438285.562022:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+35:11379:x1876361749793408:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:1.0:1789438285.562259:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+36:11379:x1876361749793408:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 238us (7933us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1789438285.562267:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 40 00000100:00100000:3.0:1789438285.634886:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438285.635121:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749793664 00000100:00100000:1.0:1789438285.635133:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749793664 00000100:00100000:1.0:1789438285.635198:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 150 00000100:00100000:1.0:1789438285.635210:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+36:11382:x1876361749793664:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438285.635249:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438285.635271:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb925737 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa3d4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.635343:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb92573e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.635359:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb92573e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.635371:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb92573e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.635387:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925745 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.635394:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925745 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.635400:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925745 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.635516:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb92574c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.635525:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb92574c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.635532:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb92574c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438285.635542:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789438285.635647:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb92573e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.635655:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb92573e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.635662:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb92573e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.635668:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dac00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438285.635672:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb92573e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.635679:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb92573e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.635689:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:1.0:1789438285.635693:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438285.635697:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb92573e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.635703:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb92573e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.635902:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925745 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.635909:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925745 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.635914:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925745 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.635930:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dba00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438285.635933:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925745 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.635938:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925745 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.635946:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9991c7c83900) 00010000:00010000:1.0:1789438285.635948:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438285.636090:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925745 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.636098:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925745 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.636141:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb925737 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3d4 expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.636155:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb92574c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3d4 expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.636162:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872700) 00010000:00010000:1.0:1789438285.636165:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789438285.636167:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9dbe00, rc 0) 00000100:00100000:1.0:1789438285.636795:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+38:11382:x1876361749793664:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 1585us (1916us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1789438285.636805:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 150 00000100:00100000:2.0:1789438285.644576:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438285.648066:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749793792 00000100:00100000:1.0:1789438285.648096:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749793792 00000100:00100000:0.0:1789438285.655020:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 151 00000100:00100000:0.0:1789438285.655043:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c31f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+38:11382:x1876361749793792:12345-192.168.206.9@tcp:54:lfs.0 00010000:00010000:0.0:1789438285.655123:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb92575a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.655139:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb92575a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.655151:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb92575a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.655180:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb92575a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.655187:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb92575a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.655194:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb92575a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.655201:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438285.655206:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb92575a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.655215:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb92575a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.655226:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872700) 00010000:00010000:0.0:1789438285.655230:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789438285.655234:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb92575a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.655241:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb92575a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438285.655342:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c31f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+38:11382:x1876361749793792:12345-192.168.206.9@tcp:54:lfs.0 Request processed in 302us (10774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438285.655350:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 151 00000100:00100000:2.0:1789438285.663455:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438285.663557:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749794048 00000100:00100000:1.0:1789438285.663567:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749794048 00000100:00100000:1.0:1789438285.663624:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 41 00000100:00100000:1.0:1789438285.663639:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c31fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+38:11382:x1876361749794048:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:0.0:1789438285.664153:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c31fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+39:11382:x1876361749794048:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 517us (703us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1789438285.664161:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 41 00010000:00010000:1.0:1789438285.687060:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438285.867350:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438285.867468:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749794304 00000100:00100000:2.0:1789438285.867478:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749794304 00000100:00100000:2.0:1789438285.867586:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 152 00000100:00100000:2.0:1789438285.867598:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff999201d3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+39:11413:x1876361749794304:12345-192.168.206.9@tcp:101:cat.0 00010000:00010000:2.0:1789438285.867621:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438285.867645:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925761 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa3db expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.867790:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925768 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.867804:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.867818:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438285.867845:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789438285.867983:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925761 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3db expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.868001:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925768 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3db expref: 41 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438285.868010:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872700) 00010000:00010000:2.0:1789438285.868013:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789438285.868016:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f0000, rc 0) 00000100:00100000:2.0:1789438285.868085:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff999201d3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+41:11413:x1876361749794304:12345-192.168.206.9@tcp:101:cat.0 Request processed in 490us (744us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1789438285.868093:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 152 00000100:00100000:2.0:1789438285.872070:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438285.872106:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438285.872169:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749794432 00000100:00100000:3.0:1789438285.872179:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749794432 00000100:00100000:3.0:1789438285.872325:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 12 00000100:00100000:3.0:1789438285.872337:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c31fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+41:2353:x1876361749794432:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789438285.872352:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438285.872376:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925768 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3db expref: 41 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438285.872394:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872700) 00010000:00010000:3.0:1789438285.872410:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789438285.872466:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c31fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+40:2353:x1876361749794432:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 132us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438285.872473:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 12 00000100:00100000:0.0:1789438285.872528:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749794688 00000100:00100000:0.0:1789438285.872532:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749794688 00000100:00100000:0.0:1789438285.872563:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 42 00000100:00100000:0.0:1789438285.872570:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c31faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+40:11413:x1876361749794688:12345-192.168.206.9@tcp:35:cat.0 00000100:00100000:0.0:1789438285.872824:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c31faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+41:11413:x1876361749794688:12345-192.168.206.9@tcp:35:cat.0 Request processed in 253us (716us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1789438285.872831:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 42 00000100:00100000:3.0:1789438285.922510:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438285.922629:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749794944 00000100:00100000:0.0:1789438285.922640:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749794944 00000100:00100000:0.0:1789438285.922762:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 153 00000100:00100000:0.0:1789438285.922773:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+41:11419:x1876361749794944:12345-192.168.206.9@tcp:101:dd.0 00010000:00010000:0.0:1789438285.922798:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438285.922800:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789438285.922825:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb9256ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3b1 expref: 41 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.922843:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:0.0:1789438285.922848:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789438285.922861:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925776 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa3e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.922972:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92577d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.922986:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb92574c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3d4 expref: 41 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.922995:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92577d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.923040:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb92574c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3d4 expref: 41 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.923055:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb92574c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3d4 expref: 41 pid: 5839 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438285.923069:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d05d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876361769721344:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789438285.923268:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9990c1385180 going to sleep for 11 seconds 00000100:00100000:0.0:1789438285.933859:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d05d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876361769721344:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438285.933894:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92577d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438285.933983:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438285.936925:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749795072 00000100:00100000:0.0:1789438285.936942:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749795072 00010000:00010000:1.0:1789438285.939909:0:8438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb92574c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3d4 expref: 42 pid: 5839 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438285.939978:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 62 00000100:00100000:1.0:1789438285.939990:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c31f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1274be99-2d57-4dac-a13e-a89426512ee0+42:2354:x1876361749795072:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789438285.940007:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438285.940014:0:8438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb92574c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3d4 expref: 42 pid: 5839 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.940039:0:8438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb92574c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3d4 expref: 42 pid: 5839 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.940061:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb92574c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3d4 expref: 42 pid: 5839 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.940076:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872700) 00010000:00010000:1.0:1789438285.940081:0:8438:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92577d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.940091:0:8438:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92577d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.940126:0:8438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92577d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.940345:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438285.940451:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c31f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1274be99-2d57-4dac-a13e-a89426512ee0+41:2354:x1876361749795072:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 463us (6468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438285.940459:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 62 00010000:00010000:0.0:1789438285.940524:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92577d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.940532:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92577d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438285.940561:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789438285.940701:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925776 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3e2 expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.940761:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92577d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3e2 expref: 41 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.940769:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872700) 00010000:00010000:0.0:1789438285.940772:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789438285.940775:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63000, rc 0) 00000100:00100000:0.0:1789438285.940799:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+41:11419:x1876361749794944:12345-192.168.206.9@tcp:101:dd.0 Request processed in 18028us (18300us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1789438285.940806:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 153 00000100:00100000:2.0:1789438285.946620:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438285.946688:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749795328 00000100:00100000:0.0:1789438285.946699:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749795328 00000100:00100000:0.0:1789438285.946786:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 154 00000100:00100000:0.0:1789438285.946795:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c31fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+41:11419:x1876361749795328:12345-192.168.206.9@tcp:36:dd.0 00010000:00010000:0.0:1789438285.947052:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb92578b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.947069:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb92578b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438285.947081:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb92578b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789438285.947137:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1789438285.947180:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a4c3a27 reply state 00000000561352b3 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb92578b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438285.947189:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789438285.947269:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c31fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+44:11419:x1876361749795328:12345-192.168.206.9@tcp:36:dd.0 Request processed in 474us (658us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1789438285.947276:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 154 00000020:00080000:0.0:1789438285.947280:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789438285.954408:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb92578b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.954426:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb92578b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.954433:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb92578b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.954439:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63a00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438285.954445:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb92578b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.954454:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb92578b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.954471:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872700) 00010000:00010000:1.0:1789438285.954475:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438285.954480:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb92578b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438285.954486:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb92578b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438286.217983:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438286.218099:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749795456 00000100:00100000:0.0:1789438286.218109:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749795456 00000100:00100000:0.0:1789438286.218175:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 155 00000100:00100000:0.0:1789438286.218186:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c31f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+43:11433:x1876361749795456:12345-192.168.206.9@tcp:101:stat.0 00010000:00010000:0.0:1789438286.218210:0:7624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438286.218230:0:7624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925792 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa3e9 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.218292:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb925799 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.218306:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb925799 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.218318:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb925799 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.218332:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb9257a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.218339:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb9257a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.218345:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb9257a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.218437:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9257a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.218448:0:7624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92577d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3e2 expref: 44 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.218457:0:7624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9257a7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.218490:0:7624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92577d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3e2 expref: 44 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.218503:0:7624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92577d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3e2 expref: 44 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438286.218518:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d05d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7624:1876361769721472:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789438286.218602:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9990c13859c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438286.227169:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00080000:1.0:1789438286.227391:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789438286.227469:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749795712 00000100:00100000:2.0:1789438286.227478:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749795712 00000100:00100000:2.0:1789438286.227533:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 43 00000100:00100000:2.0:1789438286.227543:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+45:5593:x1876361749795712:12345-192.168.206.9@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789438286.227881:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+46:5593:x1876361749795712:12345-192.168.206.9@tcp:35:ldlm_bl.0 Request processed in 339us (721us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1789438286.227890:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 43 00000100:00100000:0.0:1789438286.228014:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d05d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7624:1876361769721472:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438286.228050:0:7624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9257a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438286.233330:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438286.233465:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749795840 00000100:00100000:3.0:1789438286.233476:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749795840 00010000:00010000:3.0:1789438286.233522:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92577d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3e2 expref: 46 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438286.233564:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 63 00000100:00100000:3.0:1789438286.233574:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d055ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+46:2353:x1876361749795840:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789438286.233588:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438286.233595:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92577d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3e2 expref: 46 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438286.233609:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92577d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3e2 expref: 46 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438286.233630:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb92577d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3e2 expref: 46 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438286.233647:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872700) 00010000:00010000:3.0:1789438286.233651:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9257a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438286.233662:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9257a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438286.233681:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9257a7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438286.233743:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789438286.233788:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d055ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+45:2353:x1876361749795840:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 215us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438286.233795:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 63 00010000:00010000:0.0:1789438286.234038:0:7624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9257a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.234047:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9257a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438286.234091:0:7624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789438286.234100:0:7624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789438286.234122:0:7624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9257a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.234135:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9257a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.234144:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb925799 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.234151:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb925799 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.234159:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb925799 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.234165:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d62200 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438286.234169:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb925799 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.234177:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb925799 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.234186:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:0.0:1789438286.234188:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438286.234192:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb925799 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.234197:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb925799 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.234208:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb9257a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.234223:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb9257a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.234229:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb9257a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.234234:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63600 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438286.234237:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb9257a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.234244:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb9257a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.234252:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9991c3ac2b00) 00010000:00010000:0.0:1789438286.234254:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438286.234257:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb9257a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.234264:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb9257a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.234296:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925792 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3e9 expref: 45 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.234309:0:7624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9257a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3e9 expref: 44 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.234316:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872700) 00010000:00010000:0.0:1789438286.234318:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789438286.234326:0:7624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63800, rc 0) 00000100:00100000:0.0:1789438286.234364:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c31f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+44:11433:x1876361749795456:12345-192.168.206.9@tcp:101:stat.0 Request processed in 16181us (16390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438286.234372:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 155 00000100:00100000:1.0:1789438286.298309:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438286.298580:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749795968 00000100:00100000:3.0:1789438286.298591:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749795968 00000100:00100000:3.0:1789438286.298651:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 289 00000100:00100000:3.0:1789438286.298663:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+13:2354:x1876361749795968:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438286.298771:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58dec870-790c-4419-a02f-595f69c3b298+13:2354:x1876361749795968:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 110us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438286.298781:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 289 00000100:00100000:3.0:1789438286.301340:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438286.301404:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438286.301425:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749796096 00000100:00100000:0.0:1789438286.301435:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749796096 00000100:00100000:0.0:1789438286.301508:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 84 00000100:00100000:0.0:1789438286.301520:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1274be99-2d57-4dac-a13e-a89426512ee0+6:2354:x1876361749796096:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789438286.301592:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1274be99-2d57-4dac-a13e-a89426512ee0+6:2354:x1876361749796096:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 74us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438286.301600:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 84 00000100:00080000:2.0:1789438286.301797:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789438286.301861:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749796224 00000100:00100000:1.0:1789438286.301866:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749796224 00000100:00100000:1.0:1789438286.301915:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 146 00000100:00100000:1.0:1789438286.301923:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2353:x1876361749796224:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438286.301965:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2353:x1876361749796224:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 43us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438286.301973:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 146 00000100:00080000:2.0:1789438286.302009:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789438286.309874:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438286.309989:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749796480 00000100:00100000:2.0:1789438286.310000:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749796480 00000100:00100000:2.0:1789438286.310069:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 156 00000100:00100000:2.0:1789438286.310080:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+44:11439:x1876361749796480:12345-192.168.206.9@tcp:36:truncate.0 00010000:00010000:2.0:1789438286.310136:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438286.310172:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9257a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3e9 expref: 44 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.310193:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872700) 00010000:00010000:2.0:1789438286.310198:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789438286.310415:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb9257ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.310430:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb9257ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.310439:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb9257ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789438286.310487:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1789438286.310511:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001372a494 reply state 000000009e08521f transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb9257ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438286.310520:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789438286.310620:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+46:11439:x1876361749796480:12345-192.168.206.9@tcp:36:truncate.0 Request processed in 541us (755us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1789438286.310627:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 156 00000020:00080000:2.0:1789438286.310632:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789438286.315173:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb9257ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.315208:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb9257ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.315217:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb9257ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.315223:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0600 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438286.315229:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb9257ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.315237:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb9257ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.315254:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872700) 00010000:00010000:2.0:1789438286.315257:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438286.315262:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb9257ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.315268:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb9257ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438286.478321:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438286.478426:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749796608 00000100:00100000:2.0:1789438286.478439:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749796608 00000100:00100000:2.0:1789438286.478550:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 157 00000100:00100000:2.0:1789438286.478561:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+45:11453:x1876361749796608:12345-192.168.206.9@tcp:101:stat.0 00010000:00010000:2.0:1789438286.478587:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438286.478610:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb9257b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa3f0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.478673:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb9257bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.478758:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb9257bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.478771:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb9257bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.478789:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb9257c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.478796:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb9257c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.478802:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb9257c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.479199:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb9257ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.479209:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb9257ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.479217:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb9257ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438286.479251:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1789438286.479256:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789438286.479275:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb9257ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.479285:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb9257ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.479304:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb9257bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.479310:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb9257bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.479317:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb9257bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.479322:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f1400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438286.479326:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb9257bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.479334:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb9257bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.479346:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:2.0:1789438286.479349:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438286.479353:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb9257bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.479359:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb9257bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.479373:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb9257c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.479379:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb9257c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.479385:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb9257c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.479395:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438286.479399:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb9257c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.479404:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb9257c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.479412:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9991d5872b00) 00010000:00010000:2.0:1789438286.479414:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438286.479417:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb9257c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.479423:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb9257c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.479456:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb9257b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3f0 expref: 47 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.479468:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb9257ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3f0 expref: 46 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.479476:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872700) 00010000:00010000:2.0:1789438286.479478:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789438286.479480:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f0000, rc 0) 00000100:00100000:2.0:1789438286.479554:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+46:11453:x1876361749796608:12345-192.168.206.9@tcp:101:stat.0 Request processed in 994us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438286.479562:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 157 00000100:00100000:0.0:1789438286.586465:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438286.586569:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749796864 00000100:00100000:2.0:1789438286.586592:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749796864 00000100:00100000:2.0:1789438286.586649:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 158 00000100:00100000:2.0:1789438286.586659:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d05d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+46:11463:x1876361749796864:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789438286.586689:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438286.586743:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb9257d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa3f7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438286.586849:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789438286.586978:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb9257d1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3f7 expref: 48 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.586993:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:2.0:1789438286.586996:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789438286.587001:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb9257d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3f7 expref: 48 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.587014:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f0600, rc 0) 00000100:00100000:2.0:1789438286.587108:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d05d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+47:11463:x1876361749796864:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 450us (652us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1789438286.587116:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 158 00000100:00100000:1.0:1789438286.591235:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438286.592300:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749797120 00000100:00100000:2.0:1789438286.592313:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749797120 00000100:00100000:2.0:1789438286.592382:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 44 00000100:00100000:2.0:1789438286.592393:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d21b9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+47:11463:x1876361749797120:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:2.0:1789438286.592644:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d21b9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+48:11463:x1876361749797120:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 253us (1420us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1789438286.592652:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 44 00000100:00100000:3.0:1789438286.678756:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438286.678856:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749797376 00000100:00100000:1.0:1789438286.678869:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749797376 00000100:00100000:1.0:1789438286.678937:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 159 00000100:00100000:1.0:1789438286.678958:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+48:11469:x1876361749797376:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:1.0:1789438286.678985:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438286.679007:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9257df lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa3fe expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.679152:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9257e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.679168:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb9257ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3f0 expref: 49 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.679177:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9257e6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.679222:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb9257ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3f0 expref: 49 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.679238:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb9257ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3f0 expref: 49 pid: 5840 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438286.679254:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff999201d39f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876361769721600:192.168.206.9@tcp:104: 00000100:00100000:1.0:1789438286.679355:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991ff88db40 going to sleep for 11 seconds 00000100:00100000:3.0:1789438286.684853:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438286.685048:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff999201d39f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876361769721600:192.168.206.9@tcp:104: 00010000:00010000:1.0:1789438286.685081:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9257e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438286.686344:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749797504 00000100:00100000:0.0:1789438286.686357:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749797504 00010000:00010000:0.0:1789438286.686419:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb9257ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3f0 expref: 50 pid: 5840 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438286.686468:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 64 00000100:00100000:0.0:1789438286.686479:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff935880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+50:2354:x1876361749797504:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789438286.686496:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438286.686503:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb9257ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3f0 expref: 50 pid: 5840 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.686517:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb9257ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3f0 expref: 50 pid: 5840 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.686543:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb9257ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3f0 expref: 50 pid: 5840 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.686579:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872700) 00010000:00010000:0.0:1789438286.686585:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9257e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.686595:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9257e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.686604:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9257e6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.686646:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789438286.686788:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9257e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.686796:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9257e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438286.686816:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1789438286.686981:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb9257df lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3fe expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.686998:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9257e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3fe expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.687004:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872700) 00010000:00010000:2.0:1789438286.687007:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789438286.687010:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9da000, rc 0) 00000100:00100000:0.0:1789438286.687113:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff935880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+50:2354:x1876361749797504:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 625us (2258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438286.687122:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 64 00000100:00100000:2.0:1789438286.687619:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+49:11469:x1876361749797376:12345-192.168.206.9@tcp:101:bash.0 Request processed in 8671us (8914us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1789438286.687627:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 159 00000100:00100000:0.0:1789438286.704838:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438286.704939:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749797760 00000100:00100000:1.0:1789438286.704959:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749797760 00000100:00100000:1.0:1789438286.705030:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 160 00000100:00100000:1.0:1789438286.705041:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d05d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+49:11469:x1876361749797760:12345-192.168.206.9@tcp:36:bash.0 00010000:00010000:1.0:1789438286.705338:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9257f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.705356:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9257f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.705368:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9257f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789438286.705419:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1789438286.705444:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf2cdb63 reply state 00000000106e9cd4 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9257f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438286.705470:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789438286.705569:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d05d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+52:11469:x1876361749797760:12345-192.168.206.9@tcp:36:bash.0 Request processed in 530us (739us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1789438286.705576:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 160 00000020:00080000:1.0:1789438286.705581:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789438286.711381:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438286.712564:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9257f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.712581:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9257f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.712589:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9257f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.712596:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9da200 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438286.712601:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9257f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.712608:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9257f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.712626:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872700) 00010000:00010000:1.0:1789438286.712629:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438286.712634:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9257f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.712641:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9257f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438286.725612:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438286.725759:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749797888 00000100:00100000:2.0:1789438286.725770:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749797888 00000100:00100000:2.0:1789438286.725833:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 161 00000100:00100000:3.0:1789438286.728083:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d05d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+51:11469:x1876361749797888:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:3.0:1789438286.728126:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438286.728161:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb9257fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa405 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438286.728279:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925802 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438286.728295:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9257e6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3fe expref: 52 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438286.728304:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925802 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438286.728343:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9257e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3fe expref: 52 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438286.728361:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9257e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3fe expref: 52 pid: 5839 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438286.728376:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff937100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876361769721728:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789438286.728476:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c6c69540 going to sleep for 11 seconds 00000100:00100000:3.0:1789438286.733046:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438286.734509:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749798016 00000100:00100000:2.0:1789438286.734523:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749798016 00010000:00010000:2.0:1789438286.734576:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9257e6 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3fe expref: 53 pid: 5839 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438286.734630:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 65 00000100:00100000:2.0:1789438286.734641:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+53:2353:x1876361749798016:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789438286.734675:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438286.734683:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9257e6 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3fe expref: 53 pid: 5839 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.734698:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9257e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3fe expref: 53 pid: 5839 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.734757:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872700) 00010000:00010000:2.0:1789438286.734763:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925802 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.734774:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.734783:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925802 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438286.734803:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789438286.734863:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+53:2353:x1876361749798016:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 224us (1824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438286.734871:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 65 00010000:00010000:0.0:1789438286.735248:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb9257e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3fe expref: 52 pid: 5839 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438286.735266:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff937100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876361769721728:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438286.735291:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.735301:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.735307:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438286.735361:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789438286.735366:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789438286.735388:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.735419:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb9257fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa405 expref: 52 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.735434:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925802 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa405 expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438286.735443:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872700) 00010000:00010000:0.0:1789438286.735446:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789438286.735449:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a55000, rc 0) 00000100:00100000:0.0:1789438286.735614:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d05d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+51:11469:x1876361749797888:12345-192.168.206.9@tcp:101:bash.0 Request processed in 9314us (10011us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438286.741548:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 161 00000100:00100000:3.0:1789438286.755600:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438286.755748:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749798272 00000100:00100000:2.0:1789438286.755759:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749798272 00000100:00100000:2.0:1789438286.755816:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 45 00000100:00100000:2.0:1789438286.755827:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa7cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+51:11469:x1876361749798272:12345-192.168.206.9@tcp:35:bash.0 00000100:00100000:2.0:1789438286.756079:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa7cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+52:11469:x1876361749798272:12345-192.168.206.9@tcp:35:bash.0 Request processed in 253us (489us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1789438286.756087:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 45 00000100:00100000:3.0:1789438286.865332:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438286.865516:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749798528 00000100:00100000:1.0:1789438286.865535:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749798528 00000100:00100000:1.0:1789438286.865594:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 162 00000100:00100000:1.0:1789438286.865604:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+52:11479:x1876361749798528:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438286.865627:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438286.865646:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb925809 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa40c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438286.865767:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789438286.865887:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb925809 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa40c expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.865902:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:1.0:1789438286.865905:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789438286.865911:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb925809 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa40c expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.865925:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9da200, rc 0) 00000100:00100000:1.0:1789438286.865995:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+53:11479:x1876361749798528:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 392us (672us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1789438286.866002:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 162 00000100:00100000:0.0:1789438286.869199:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438286.869328:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749798656 00000100:00100000:1.0:1789438286.869338:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749798656 00000100:00100000:1.0:1789438286.869399:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 163 00000100:00100000:1.0:1789438286.869409:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+53:11479:x1876361749798656:12345-192.168.206.9@tcp:34:lfs.0 00010000:00010000:1.0:1789438286.869504:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925817 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.869520:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925817 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.869541:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925817 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.869557:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb92581e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.869564:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb92581e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.869570:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb92581e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.869653:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925825 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.869662:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.869670:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789438286.869743:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.869755:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925817 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.869762:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925817 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.869769:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925817 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.869784:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dae00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438286.869789:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925817 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.869797:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925817 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.869809:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:1.0:1789438286.869812:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438286.869816:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925817 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.869823:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925817 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.869836:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb92581e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.869842:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb92581e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.869848:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb92581e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.869853:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9da000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438286.869857:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb92581e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.869862:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb92581e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.869880:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9991c7c83900) 00010000:00010000:1.0:1789438286.869882:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438286.869885:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb92581e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.869891:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb92581e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.869906:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.869912:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925825 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.869917:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925825 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.869921:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9da600 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438286.869924:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925825 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.869929:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925825 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.869936:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872700) 00010000:00010000:1.0:1789438286.869939:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438286.869942:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925825 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.869947:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925825 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438286.870036:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+53:11479:x1876361749798656:12345-192.168.206.9@tcp:34:lfs.0 Request processed in 627us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438286.870044:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 163 00000100:00100000:3.0:1789438286.872433:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438286.872516:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749798912 00000100:00100000:2.0:1789438286.872526:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749798912 00000100:00100000:2.0:1789438286.872571:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 46 00000100:00100000:2.0:1789438286.872580:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+53:11479:x1876361749798912:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:2.0:1789438286.872833:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+54:11479:x1876361749798912:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 253us (406us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1789438286.872842:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 46 00000100:00100000:0.0:1789438286.935077:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438286.935258:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749799168 00000100:00100000:1.0:1789438286.935271:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749799168 00000100:00100000:1.0:1789438286.935333:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 164 00000100:00100000:1.0:1789438286.935344:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+54:11482:x1876361749799168:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438286.935368:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438286.935389:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb92582c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa413 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.935459:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb925833 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.935473:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb925833 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.935485:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb925833 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.935500:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb92583a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.935506:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb92583a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.935512:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb92583a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.935647:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb925841 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.935656:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb925841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.935663:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb925841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438286.935673:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789438286.935881:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb925833 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.935890:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb925833 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.935897:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb925833 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.935903:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9da000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438286.935907:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb925833 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.935915:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb925833 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.935927:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:1.0:1789438286.935929:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438286.935934:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb925833 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.935950:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb925833 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.935966:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb92583a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.935971:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb92583a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.935976:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb92583a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.935981:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dae00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438286.935984:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb92583a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.935990:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb92583a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.935998:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9991c7c83900) 00010000:00010000:1.0:1789438286.936001:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438286.936004:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb92583a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.936010:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb92583a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.936062:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb92582c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa413 expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.936076:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb925841 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa413 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.936089:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872700) 00010000:00010000:1.0:1789438286.936091:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789438286.936094:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9da200, rc 0) 00000100:00100000:1.0:1789438286.936368:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+56:11482:x1876361749799168:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 1024us (1298us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1789438286.936376:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 164 00000100:00100000:0.0:1789438286.939366:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438286.939411:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438286.939494:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749799424 00000100:00100000:3.0:1789438286.939505:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749799424 00000100:00100000:3.0:1789438286.939577:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:3.0:1789438286.939589:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff950380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+56:2354:x1876361749799424:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789438286.939605:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438286.939645:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb925841 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa413 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438286.939665:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872700) 00010000:00010000:3.0:1789438286.939669:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789438286.939741:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff950380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+55:2354:x1876361749799424:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 155us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438286.939749:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:1.0:1789438286.940169:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749799296 00000100:00100000:1.0:1789438286.940185:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749799296 00000100:00100000:1.0:1789438286.940217:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 165 00000100:00100000:1.0:1789438286.940225:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+55:11482:x1876361749799296:12345-192.168.206.9@tcp:54:lfs.0 00010000:00010000:1.0:1789438286.940282:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb92584f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.940296:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb92584f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.940307:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb92584f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.940331:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb92584f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.940337:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb92584f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.940344:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb92584f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.940349:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dac00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438286.940375:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb92584f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.940387:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb92584f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.940397:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872700) 00010000:00010000:1.0:1789438286.940400:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789438286.940403:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb92584f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438286.940409:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb92584f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438286.940453:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+55:11482:x1876361749799296:12345-192.168.206.9@tcp:54:lfs.0 Request processed in 229us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438286.940460:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 165 00000100:00100000:0.0:1789438286.947560:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438286.947877:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749799680 00000100:00100000:2.0:1789438286.947888:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749799680 00000100:00100000:2.0:1789438286.947947:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 47 00000100:00100000:2.0:1789438286.947967:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+55:11482:x1876361749799680:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:2.0:1789438286.948448:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+56:11482:x1876361749799680:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 481us (898us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789438286.948458:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 47 00000100:00100000:0.0:1789438287.181483:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438287.182985:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749799936 00000100:00100000:3.0:1789438287.182998:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749799936 00000100:00100000:3.0:1789438287.183072:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 166 00000100:00100000:3.0:1789438287.183084:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+56:11500:x1876361749799936:12345-192.168.206.9@tcp:101:cat.0 00010000:00010000:3.0:1789438287.183265:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438287.183287:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb925856 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa41a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.183458:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54200/0x7a8dd0fcbb92585d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.183474:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54200/0x7a8dd0fcbb92585d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.183486:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54200/0x7a8dd0fcbb92585d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789438287.183498:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789438287.184376:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb925856 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa41a expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.184406:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54200/0x7a8dd0fcbb92585d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa41a expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.184434:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872700) 00010000:00010000:3.0:1789438287.184438:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789438287.184442:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a54200, rc 0) 00000100:00100000:3.0:1789438287.184573:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+58:11500:x1876361749799936:12345-192.168.206.9@tcp:101:cat.0 Request processed in 1490us (3097us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1789438287.184582:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 166 00000001:00080000:2.0:1789438287.232184:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967441 is committed 00000001:00080000:2.0:1789438287.232205:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967453 is committed 00000004:00080000:2.0:1789438287.232229:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1789438287.232251:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9991ff88d0c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1789438287.232256:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9991faa78f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9991ff88d000 00000020:00080000:2.0:1789438287.232260:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9991faa78800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff999201d88000 00000001:00080000:2.0:1789438287.232300:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00000020:00080000:0.0:1789438287.232440:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1789438287.232624:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789438287.232883:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff999201d39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769721856:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789438287.232957:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438287.233090:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769721856 00000100:00100000:1.0:1789438287.233098:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769721856 00000100:00100000:1.0:1789438287.233173:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789438287.233184:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c31fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1876361769721856:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789438287.233209:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:1.0:1789438287.233246:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa8a94c, atime: 0x6aa8a94d, ctime: 0x6aa8a94c, blocks: 0x1 00010000:00010000:1.0:1789438287.233254:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b97342d4/0x7a8dd0fcbb92586b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438287.233270:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=339s v=(0 0) 00010000:00010000:1.0:1789438287.233274:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438287.233280:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b97342d4/0x7a8dd0fcbb92586b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438287.233318:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b97342d4/0x7a8dd0fcbb92586b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438287.233330:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b97342d4/0x7a8dd0fcbb92586b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438287.233338:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b97342d4/0x7a8dd0fcbb92586b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438287.233356:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1789438287.233503:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789438287.234092:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c31fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1876361769721856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 908us (1132us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789438287.234101:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:1.0:1789438287.234135:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:2.0:1789438287.234260:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff999201d39f80/2, rc 0, transno 4294967307 00000100:00100000:2.0:1789438287.234267:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff999201d39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769721856:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789438287.234325:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b97342d4/0x7a8dd0fcbb92586b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438287.234335:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dac00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:1.0:1789438287.234340:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b97342d4/0x7a8dd0fcbb92586b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438287.234350:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b97342d4/0x7a8dd0fcbb92586b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438287.234368:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b97342d4/0x7a8dd0fcbb92586b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438287.234381:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b97342d4/0x7a8dd0fcbb92586b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438287.234402:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438287.234405:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438287.234406:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438287.251059:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438287.251407:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749800064 00000100:00100000:1.0:1789438287.251568:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749800064 00000100:00100000:1.0:1789438287.251632:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 167 00000100:00100000:1.0:1789438287.251642:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+18:11501:x1876361749800064:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438287.251665:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438287.251685:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb925872 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa421 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438287.251772:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925879 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438287.251785:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438287.251798:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438287.251829:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789438287.251833:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789438287.251849:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438287.252852:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb925872 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa421 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438287.252883:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa421 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438287.253011:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:1.0:1789438287.253015:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789438287.253030:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9da600, rc 0) 00000100:00100000:1.0:1789438287.253154:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+19:11501:x1876361749800064:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 1511us (2103us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438287.253162:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 167 00000100:00100000:0.0:1789438287.257936:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438287.258958:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749800448 00000100:00100000:1.0:1789438287.258970:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749800448 00000100:00100000:1.0:1789438287.259080:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 48 00000100:00100000:1.0:1789438287.259092:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+19:11501:x1876361749800448:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:1.0:1789438287.259598:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+20:11501:x1876361749800448:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 507us (1669us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1789438287.259606:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 48 00000100:00100000:0.0:1789438287.261607:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438287.261694:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749800576 00000100:00100000:2.0:1789438287.261705:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749800576 00000100:00100000:2.0:1789438287.261806:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 14 00000100:00100000:2.0:1789438287.261817:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+20:11501:x1876361749800576:12345-192.168.206.9@tcp:103:lfs.0 00010000:00010000:2.0:1789438287.261833:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789438287.261858:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb925802 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa405 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438287.261882:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54200/0x7a8dd0fcbb92585d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa41a expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438287.261905:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb92570d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa3c6 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438287.261916:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872700) 00010000:00010000:2.0:1789438287.261927:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789438287.261978:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+17:11501:x1876361749800576:12345-192.168.206.9@tcp:103:lfs.0 Request processed in 163us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438287.261986:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 14 00000100:00100000:0.0:1789438287.264346:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438287.264663:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749800704 00000100:00100000:1.0:1789438287.264672:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749800704 00000100:00100000:3.0:1789438287.264849:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 168 00000100:00100000:3.0:1789438287.264862:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+17:11501:x1876361749800704:12345-192.168.206.9@tcp:58:lfs.0 00010000:00010000:3.0:1789438287.265004:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb925880 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.265029:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb925880 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.265041:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb925880 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789438287.265360:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1789438287.265825:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+17:11501:x1876361749800704:12345-192.168.206.9@tcp:58:lfs.0 Request processed in 964us (1485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438287.265834:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 168 00000100:00100000:0.0:1789438287.317843:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438287.318376:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749800832 00000100:00100000:3.0:1789438287.318386:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749800832 00000100:00100000:3.0:1789438287.318449:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 169 00000100:00100000:3.0:1789438287.318460:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+17:11503:x1876361749800832:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:3.0:1789438287.318482:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438287.318518:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925887 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa428 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.318589:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb92588e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.318603:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb92588e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.318615:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb92588e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.318700:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb925895 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.318734:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb925895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.318742:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb925895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.319039:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54200/0x7a8dd0fcbb92589c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.319049:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54200/0x7a8dd0fcbb92589c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.319056:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54200/0x7a8dd0fcbb92589c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789438287.319091:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789438287.319095:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789438287.319113:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54200/0x7a8dd0fcbb92589c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.319131:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54200/0x7a8dd0fcbb92589c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.319139:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb92588e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.319146:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb92588e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.319153:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb92588e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.319158:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438287.319162:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb92588e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.319170:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb92588e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.319181:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:3.0:1789438287.319184:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789438287.319188:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb92588e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.319194:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb92588e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.319206:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb925895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.319213:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb925895 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.319225:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb925895 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.319230:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54c00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438287.319232:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb925895 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.319238:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb925895 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.319245:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9991d192c300) 00010000:00010000:3.0:1789438287.319247:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789438287.319250:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb925895 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.319255:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb925895 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.319289:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925887 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa428 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.319303:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54200/0x7a8dd0fcbb92589c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa428 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438287.319309:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d192cb00) 00010000:00010000:3.0:1789438287.319311:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789438287.319313:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a54200, rc 0) 00000100:00100000:3.0:1789438287.319587:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+18:11503:x1876361749800832:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 1128us (1757us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438287.319604:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 169 00010000:00010000:1.0:1789438287.740610:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789438287.758172:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:1.0:1789438287.758191:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000040:00080000:3.0:1789438288.183907:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789438288.183918:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789438288.183971:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1789438288.183978:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789438288.184119:0:11668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f438f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11668:1876361769721984:192.168.206.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789438288.184220:0:11668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991eb2c8540 going to sleep for 11 seconds 00000100:00100000:0.0:1789438288.196540:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438288.196575:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749800960 00000100:00100000:0.0:1789438288.196584:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749800960 00000100:00100000:0.0:1789438288.196644:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 170 00000100:00100000:2.0:1789438288.196653:0:11668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f438f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11668:1876361769721984:192.168.206.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789438288.196654:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+19:11515:x1876361749800960:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789438288.196685:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789438288.196801:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+18:11515:x1876361749800960:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 Request processed in 148us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438288.196809:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 170 00000100:00080000:0.0:1789438288.196830:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789438288.207612:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438288.208340:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749801088 00000100:00100000:1.0:1789438288.208350:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749801088 00000100:00100000:1.0:1789438288.208423:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 171 00000100:00100000:1.0:1789438288.208435:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+18:11515:x1876361749801088:12345-192.168.206.9@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789438288.208507:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9258a3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.208522:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9258a3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.208534:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9258a3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.208590:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9258aa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.208599:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9258aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.208606:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9258aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.208635:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb9258b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.208644:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb9258b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.208651:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb9258b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438288.208693:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789438288.208697:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789438288.208729:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb9258b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.208748:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9258a3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.208755:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9258a3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.208762:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9258a3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.208768:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dba00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438288.208772:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9258a3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.208780:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9258a3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.208792:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9991d5872000) 00010000:00010000:1.0:1789438288.208795:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438288.208799:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9258a3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.208805:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9258a3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.208818:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9258aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.208824:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9258aa lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.208829:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9258aa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.208841:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dbe00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438288.208844:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9258aa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.208851:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9258aa lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.208859:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9991c7c83900) 00010000:00010000:1.0:1789438288.208861:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438288.208864:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9258aa lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.208870:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9258aa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.208884:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb9258b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.208889:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb9258b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.208894:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb9258b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.208899:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9db400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438288.208902:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb9258b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.208909:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb9258b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.208976:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d192cb00) 00010000:00010000:1.0:1789438288.208979:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438288.208983:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb9258b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.208988:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb9258b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438288.209079:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+18:11515:x1876361749801088:12345-192.168.206.9@tcp:34:lhsmtool_posix.0 Request processed in 645us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438288.209086:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 171 00000100:00100000:3.0:1789438288.224961:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438288.225000:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749801344 00000100:00100000:3.0:1789438288.225009:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749801344 00000100:00100000:3.0:1789438288.225069:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 172 00000100:00100000:3.0:1789438288.225078:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+18:11515:x1876361749801344:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789438288.225108:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438288.225128:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb9258b8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa42f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.225235:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9258bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.225249:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9258bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.225260:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9258bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789438288.225271:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789438288.225376:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9258bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.225390:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9258bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.225398:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9258bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.225405:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54c00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438288.225409:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9258bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.225417:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9258bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.225429:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d192cb00) 00010000:00010000:3.0:1789438288.225431:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789438288.225437:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9258bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.225443:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9258bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.225480:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb9258b8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa42f expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.225491:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9991d5872000) 00010000:00010000:3.0:1789438288.225493:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789438288.225497:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb9258b8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa42f expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.225505:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a54400, rc 0) 00000100:00100000:3.0:1789438288.225566:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+19:11515:x1876361749801344:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 489us (622us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1789438288.225575:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 172 00000040:00080000:0.0:1789438288.225834:0:12438:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789438288.225838:0:12438:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789438288.225882:0:12438:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1789438288.225887:0:12438:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789438288.234120:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438288.234415:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749801472 00000100:00100000:3.0:1789438288.234426:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749801472 00000100:00100000:3.0:1789438288.234489:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 173 00000100:00100000:3.0:1789438288.234501:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c31faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+19:11515:x1876361749801472:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789438288.234536:0:5840:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789438288.234691:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c31faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+19:11515:x1876361749801472:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 Request processed in 192us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438288.234700:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 173 00000100:00100000:0.0:1789438288.245461:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438288.247467:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749801728 00000100:00100000:3.0:1789438288.247479:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749801728 00000100:00100000:3.0:1789438288.247604:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 174 00000100:00100000:3.0:1789438288.247614:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+19:11515:x1876361749801728:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789438288.247633:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438288.247636:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789438288.247661:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925879 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa421 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.247675:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:3.0:1789438288.247680:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789438288.247692:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb9258cd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa436 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789438288.248405:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1789438288.248655:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9258d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.248674:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9258d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.248685:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9258d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.248764:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb9258cd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa436 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.248779:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9258d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa436 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.248787:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9991d192c000) 00010000:00010000:3.0:1789438288.248790:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789438288.248793:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a54c00, rc 0) 00000100:00100000:3.0:1789438288.248859:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+20:11515:x1876361749801728:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 1245us (3406us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1789438288.248867:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 174 00000100:00100000:3.0:1789438288.255301:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438288.256430:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749801984 00000100:00100000:2.0:1789438288.256442:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749801984 00000100:00100000:2.0:1789438288.256499:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 175 00000100:00100000:2.0:1789438288.256510:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f46e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+20:11515:x1876361749801984:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789438288.256568:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438288.256602:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54c00/0x7a8dd0fcbb9258d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa436 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.256618:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9991d192c000) 00010000:00010000:2.0:1789438288.256628:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789438288.256650:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9258e2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.256663:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9258e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.256673:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9258e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.256687:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb9258e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x79bfe078 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.256694:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb9258e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x79bfe078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.256700:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb9258e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x79bfe078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.256909:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9258e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.256917:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9258e2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.256924:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9258e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.256930:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f1000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438288.256942:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9258e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.256950:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9258e2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.256959:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:2.0:1789438288.256962:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438288.256965:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9258e2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.256971:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb9258e2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.256980:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb9258e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x79bfe078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.256986:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb9258e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x79bfe078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.256991:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb9258e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x79bfe078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.256996:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f1800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438288.256999:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb9258e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x79bfe078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.257005:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb9258e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x79bfe078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.257024:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x79bfe078 (ffff9991d5872c00) 00010000:00010000:2.0:1789438288.257026:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438288.257036:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb9258e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x79bfe078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.257042:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb9258e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x79bfe078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438288.257137:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f46e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+19:11515:x1876361749801984:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 627us (1844us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789438288.257153:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 175 00000100:00100000:0.0:1789438288.271348:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438288.271491:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749802112 00000100:00100000:3.0:1789438288.271502:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749802112 00000100:00100000:3.0:1789438288.271565:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 176 00000100:00100000:3.0:1789438288.271576:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+19:11515:x1876361749802112:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789438288.271596:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438288.271618:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb9258f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa43d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.271670:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9258f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.271685:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9258f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.271698:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9258f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.271823:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb9258f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa43d expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.271840:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9258f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa43d expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.271858:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9991d192c700) 00010000:00010000:3.0:1789438288.271862:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789438288.271866:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a55800, rc 0) 00000100:00100000:3.0:1789438288.271923:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+20:11515:x1876361749802112:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 348us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438288.271930:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 176 00000100:00100000:0.0:1789438288.274545:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438288.276024:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749802368 00000100:00100000:3.0:1789438288.276037:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749802368 00000100:00100000:3.0:1789438288.276097:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 177 00000100:00100000:3.0:1789438288.276108:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+20:11515:x1876361749802368:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789438288.276317:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb9258fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.276345:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb9258fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.276358:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb9258fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789438288.276637:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1789438288.276647:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 340541939001ns, next at 341541936941ns, rc = 0 00000004:00010000:3.0:1789438288.278682:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000428bddbd reply state 0000000050ec3af8 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb9258fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438288.278702:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789438288.278865:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+22:11515:x1876361749802368:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 2755us (4324us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1789438288.278875:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 177 00010000:00010000:2.0:1789438288.285278:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb9258fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.285364:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb9258fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.285372:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb9258fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.285378:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438288.285383:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb9258fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.285390:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb9258fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.285406:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9991d192c700) 00010000:00010000:2.0:1789438288.285410:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789438288.285414:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb9258fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.285421:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55000/0x7a8dd0fcbb9258fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438288.291421:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438288.291494:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749802496 00000100:00100000:3.0:1789438288.291504:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749802496 00000100:00100000:3.0:1789438288.291565:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 178 00000100:00100000:3.0:1789438288.291575:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+21:11515:x1876361749802496:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789438288.291599:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438288.291620:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925905 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa444 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.291686:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925905 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa444 expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.291702:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925905 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa444 expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.291759:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9991d192c700) 00010000:00010000:3.0:1789438288.291762:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789438288.291766:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a54400, rc 0) 00000100:00100000:3.0:1789438288.291830:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+22:11515:x1876361749802496:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 256us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438288.292268:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 178 00000100:00100000:0.0:1789438288.299172:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438288.304775:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749802624 00000100:00100000:3.0:1789438288.304790:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749802624 00000100:00100000:3.0:1789438288.304884:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 51 00000100:00100000:3.0:1789438288.304896:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+6:2353:x1876361749802624:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789438288.305255:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+7:2353:x1876361749802624:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 Request processed in 360us (6091us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789438288.305263:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 51 00000100:00080000:3.0:1789438288.305286:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789438288.308525:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438288.308619:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749802880 00000100:00100000:0.0:1789438288.308629:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749802880 00000100:00100000:0.0:1789438288.308690:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 49 00000100:00100000:0.0:1789438288.308700:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c31f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+22:11515:x1876361749802880:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789438288.309357:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c31f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+23:11515:x1876361749802880:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 Request processed in 655us (837us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1789438288.309373:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 49 00000100:00100000:3.0:1789438288.312501:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438288.312671:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749803136 00000100:00100000:0.0:1789438288.312682:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749803136 00000100:00100000:0.0:1789438288.312762:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 179 00000100:00100000:0.0:1789438288.312775:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f46e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+23:11515:x1876361749803136:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789438288.313376:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f46e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+23:11515:x1876361749803136:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 602us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438288.313386:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 179 00000100:00100000:3.0:1789438288.316367:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438288.316461:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749803264 00000100:00100000:2.0:1789438288.316472:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749803264 00000100:00100000:2.0:1789438288.316530:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 180 00000100:00100000:2.0:1789438288.316540:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f46e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+23:11515:x1876361749803264:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789438288.316559:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438288.316579:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb92590c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa44b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.316648:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925913 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.316662:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.316673:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438288.316704:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789438288.317547:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.317580:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb92590c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa44b expref: 25 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.317597:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925913 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa44b expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.317606:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9991d192c700) 00010000:00010000:2.0:1789438288.317617:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789438288.317621:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f1800, rc 0) 00000100:00100000:2.0:1789438288.317772:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f46e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+24:11515:x1876361749803264:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 1232us (1411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438288.317780:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 180 00000100:00100000:3.0:1789438288.321499:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438288.321535:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749803392 00000100:00100000:3.0:1789438288.321544:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749803392 00000100:00100000:3.0:1789438288.321597:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 52 00000100:00100000:3.0:1789438288.321608:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f46e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1274be99-2d57-4dac-a13e-a89426512ee0+7:2354:x1876361749803392:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789438288.321624:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438288.321644:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e473c913/0x7a8dd0fcbb92591a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa452 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789438288.321680:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa8a950, blocks: 0x1 00010000:00010000:3.0:1789438288.321700:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=340s v=(0 0) 00010000:00010000:3.0:1789438288.322296:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438288.322311:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e473c913/0x7a8dd0fcbb92591a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa452 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.322333:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e473c913/0x7a8dd0fcbb92591a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa452 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.322347:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a54a00, rc 0) 00000100:00100000:3.0:1789438288.322408:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f46e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1274be99-2d57-4dac-a13e-a89426512ee0+8:2354:x1876361749803392:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 801us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438288.322415:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 52 00000100:00100000:2.0:1789438288.325535:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438288.325612:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749803648 00000100:00100000:3.0:1789438288.325624:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749803648 00000100:00100000:3.0:1789438288.325675:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 181 00000100:00100000:3.0:1789438288.325687:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c31fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+24:11515:x1876361749803648:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789438288.325833:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c31fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+24:11515:x1876361749803648:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 148us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438288.325841:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 181 00000100:00100000:0.0:1789438288.339125:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438288.339182:0:11995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749803776 00000100:00100000:1.0:1789438288.339194:0:11995:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749803776 00000100:00100000:1.0:1789438288.339242:0:11995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 53 00000100:00100000:1.0:1789438288.339252:0:11995:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1274be99-2d57-4dac-a13e-a89426512ee0+8:11515:x1876361749803776:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789438288.339269:0:11995:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438288.339288:0:11995:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb925921 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa459 expref: -99 pid: 11995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.339321:0:11995:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e473c913/0x7a8dd0fcbb92591a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa452 expref: 9 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.339330:0:11995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438288.339334:0:11995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438288.339340:0:11995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb925921 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa459 expref: 9 pid: 11995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.339394:0:11995:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e473c913/0x7a8dd0fcbb92591a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa452 expref: 9 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.339408:0:11995:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e473c913/0x7a8dd0fcbb92591a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa452 expref: 9 pid: 6681 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438288.339422:0:11995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff999201d38700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11995:1876361769722112:192.168.206.9@tcp:104: 00000100:00100000:1.0:1789438288.339516:0:11995:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c12ed540 going to sleep for 11 seconds 00000100:00100000:0.0:1789438288.342859:0:11995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff999201d38700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11995:1876361769722112:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438288.342897:0:11995:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb925921 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa459 expref: 9 pid: 11995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.342916:0:11995:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9dba00, rc 0) 00000100:00100000:0.0:1789438288.342984:0:11995:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1274be99-2d57-4dac-a13e-a89426512ee0+9:11515:x1876361749803776:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 3733us (3867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438288.342993:0:11995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 53 00000100:00100000:2.0:1789438288.344621:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438288.345636:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749803904 00000100:00100000:3.0:1789438288.345649:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749803904 00010000:00010000:3.0:1789438288.345692:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e473c913/0x7a8dd0fcbb92591a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa452 expref: 9 pid: 6681 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438288.345778:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 66 00000100:00100000:3.0:1789438288.345790:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c31f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+9:2353:x1876361749803904:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789438288.345807:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438288.345829:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e473c913/0x7a8dd0fcbb92591a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa452 expref: 9 pid: 6681 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.345843:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e473c913/0x7a8dd0fcbb92591a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa452 expref: 9 pid: 6681 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.345879:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e473c913/0x7a8dd0fcbb92591a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa452 expref: 9 pid: 6681 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.345896:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438288.345900:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438288.345907:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb925921 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa459 expref: 8 pid: 11995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.345918:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb925921 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa459 expref: 8 pid: 11995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.345957:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb925921 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa459 expref: 8 pid: 11995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438288.345971:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f46e6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5823:1876361769722240:192.168.206.9@tcp:105: 00000100:00100000:3.0:1789438288.346073:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991eb2c8900 going to sleep for 11 seconds 00000100:00100000:2.0:1789438288.354770:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438288.354936:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749804032 00000100:00100000:1.0:1789438288.354957:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749804032 00002000:00100000:1.0:1789438288.355007:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9991c31fb100 x1876361749804032/t0(0) o4->1274be99-2d57-4dac-a13e-a89426512ee0@192.168.206.9@tcp:719/0 lens 504/0 e 0 to 0 dl 1789438299 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789438288.355028:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9991c31fb100 with x1876361749804032 ext(0->8) 00002000:00010000:1.0:1789438288.355034:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9991c31fb100 00000100:00100000:1.0:1789438288.355069:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:1.0:1789438288.355080:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c31fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1274be99-2d57-4dac-a13e-a89426512ee0+9:2353:x1876361749804032:12345-192.168.206.9@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789438288.355397:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f46e6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5823:1876361769722240:192.168.206.9@tcp:105: 00010000:00010000:3.0:1789438288.355422:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789438288.355478:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c31f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+11:2353:x1876361749803904:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 9690us (10864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438288.355478:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c31fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1274be99-2d57-4dac-a13e-a89426512ee0+11:2353:x1876361749804032:12345-192.168.206.9@tcp:4:lhsmtool_posix.0 Request processed in 399us (717us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789438288.355486:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:3.0:1789438288.355487:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 66 00002000:00100000:1.0:1789438288.355493:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9991c31fb100 x1876361749804032/t4294967314(0) o4->1274be99-2d57-4dac-a13e-a89426512ee0@192.168.206.9@tcp:719/0 lens 504/448 e 0 to 0 dl 1789438299 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789438288.355500:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9991c31fb100 with x1876361749804032 ext(0->8) 00002000:00010000:1.0:1789438288.355504:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9991c31fb100 00000100:00100000:1.0:1789438288.359792:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438288.359882:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749804160 00000100:00100000:0.0:1789438288.359892:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749804160 00000100:00100000:0.0:1789438288.359952:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 182 00000100:00100000:0.0:1789438288.359964:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff999201d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+24:11515:x1876361749804160:12345-192.168.206.9@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1789438288.401412:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff999201d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+24:11515:x1876361749804160:12345-192.168.206.9@tcp:44:lhsmtool_posix.0 Request processed in 41441us (41619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438288.401426:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 182 00000001:00080000:2.0:1789438288.401465:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:2.0:1789438288.401474:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:2.0:1789438288.401499:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:2.0:1789438288.401631:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c31f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769722368:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789438288.401681:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1789438288.401791:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789438288.401800:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769722368 00000020:00080000:1.0:1789438288.401802:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789438288.401808:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769722368 00000100:00100000:3.0:1789438288.401946:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789438288.401957:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c31f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769722368:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1789438288.402062:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1789438288.402403:0:8192:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789438288.402407:0:8192:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789438288 00002000:00010000:3.0:1789438288.402409:0:8192:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789438288.402411:0:8192:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789438288 -> 1789438288 00002000:00010000:3.0:1789438288.402414:0:8192:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789438288.402498:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c31f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1876361769722368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 543us (815us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789438288.402505:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:2.0:1789438288.404440:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9991c31f9500/2, rc 0, transno 4294967315 00000100:00100000:2.0:1789438288.404453:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c31f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769722368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789438288.405849:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438288.406964:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749804288 00000100:00100000:2.0:1789438288.406976:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749804288 00000100:00100000:2.0:1789438288.407047:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 55 00000100:00100000:2.0:1789438288.407058:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+10:2354:x1876361749804288:12345-192.168.206.9@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789438288.497843:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:3.0:1789438288.497877:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:2.0:1789438288.498432:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+7:2354:x1876361749804288:12345-192.168.206.9@tcp:16:lhsmtool_posix.0 Request processed in 91371us (92582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438288.498444:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 55 00000100:00100000:0.0:1789438288.501927:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438288.502247:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749804544 00000100:00100000:3.0:1789438288.502258:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749804544 00000100:00100000:3.0:1789438288.502386:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 183 00000100:00100000:3.0:1789438288.502397:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+18:11515:x1876361749804544:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789438288.502448:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438288.502475:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925913 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa44b expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.502507:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9991d192c700) 00010000:00010000:3.0:1789438288.502513:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789438288.502546:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb925928 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.502657:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb925928 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.502668:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb925928 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789438288.503278:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1d60d01 reply state 0000000081bdc3e2 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb925928 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438288.503358:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789438288.503471:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+19:11515:x1876361749804544:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 1074us (1551us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1789438288.503479:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 183 00010000:00010000:2.0:1789438288.506432:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb925928 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.506448:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb925928 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.506456:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb925928 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.506463:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54a00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438288.506468:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb925928 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.506475:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb925928 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.506491:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9991d192c700) 00010000:00010000:2.0:1789438288.506494:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438288.506499:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb925928 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.506506:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb925928 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438288.514479:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438288.515257:0:11995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749804672 00000100:00100000:1.0:1789438288.515269:0:11995:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749804672 00000100:00100000:1.0:1789438288.515397:0:11995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 56 00000100:00100000:1.0:1789438288.515408:0:11995:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1274be99-2d57-4dac-a13e-a89426512ee0+7:2353:x1876361749804672:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789438288.516077:0:11995:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789438288.516081:0:11995:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789438288 -> 1789438286 00002000:00010000:1.0:1789438288.516084:0:11995:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789438285 00002000:00010000:1.0:1789438288.516086:0:11995:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789438288 -> 1789438286 00002000:00010000:1.0:1789438288.516088:0:11995:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789438288.516382:0:11995:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1274be99-2d57-4dac-a13e-a89426512ee0+8:2353:x1876361749804672:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 Request processed in 973us (1910us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789438288.516392:0:11995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 56 00000100:00100000:0.0:1789438288.519234:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438288.519383:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749804928 00000100:00100000:3.0:1789438288.519393:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749804928 00000100:00100000:3.0:1789438288.519482:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 184 00000100:00100000:3.0:1789438288.519493:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+18:11515:x1876361749804928:12345-192.168.206.9@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789438288.519574:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92592f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.519596:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9258f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa43d expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.519625:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92592f lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.519673:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9258f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa43d expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.519700:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9258f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa43d expref: 18 pid: 5838 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438288.520252:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f46e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876361769722496:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789438288.520417:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d019c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789438288.524113:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f46e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876361769722496:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789438288.524148:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92592f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438288.525241:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438288.525476:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749805056 00000100:00100000:3.0:1789438288.525485:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749805056 00010000:00010000:3.0:1789438288.525522:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9258f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa43d expref: 19 pid: 5838 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438288.525563:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 67 00000100:00100000:3.0:1789438288.525573:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+19:2354:x1876361749805056:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789438288.525588:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438288.525594:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9258f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa43d expref: 19 pid: 5838 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.525622:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9258f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa43d expref: 19 pid: 5838 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.525642:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9258f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa43d expref: 19 pid: 5838 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.525657:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9991d192c700) 00010000:00010000:3.0:1789438288.525662:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92592f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.525672:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92592f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.525680:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92592f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.525703:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789438288.525779:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+18:2354:x1876361749805056:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 207us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438288.525786:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 67 00010000:00010000:0.0:1789438288.525841:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92592f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.525848:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92592f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.525875:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92592f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.525882:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92592f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.525888:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92592f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.525894:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55a00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438288.525897:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92592f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.525904:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92592f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.525913:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9991d192c700) 00010000:00010000:0.0:1789438288.525915:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789438288.525919:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92592f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.525925:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb92592f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438288.526085:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+17:11515:x1876361749804928:12345-192.168.206.9@tcp:55:lhsmtool_posix.0 Request processed in 6594us (6860us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789438288.526100:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 184 00000100:00100000:0.0:1789438288.531313:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438288.531379:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749805184 00000100:00100000:3.0:1789438288.531389:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749805184 00000100:00100000:3.0:1789438288.531451:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 57 00000100:00100000:3.0:1789438288.531462:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1274be99-2d57-4dac-a13e-a89426512ee0+8:2353:x1876361749805184:12345-192.168.206.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789438288.531509:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000761ac94b/0x7a8dd0fcbb925936 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.531550:0:8192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb925921 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa459 expref: 8 pid: 11995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.531559:0:8192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438288.531563:0:8192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789438288.531568:0:8192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000761ac94b/0x7a8dd0fcbb925936 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.531606:0:8192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb925921 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa459 expref: 8 pid: 11995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.531621:0:8192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb925921 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa459 expref: 8 pid: 11995 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438288.531638:0:8192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f46e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8192:1876361769722624:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789438288.531759:0:8192:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d019c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789438288.542550:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438288.542677:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749805312 00000100:00100000:2.0:1789438288.542688:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749805312 00010000:00010000:2.0:1789438288.542774:0:8438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb925921 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa459 expref: 9 pid: 11995 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438288.542814:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 68 00000100:00100000:2.0:1789438288.542825:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d055f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1274be99-2d57-4dac-a13e-a89426512ee0+9:2353:x1876361749805312:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789438288.542857:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438288.542885:0:8438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb925921 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa459 expref: 9 pid: 11995 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.542900:0:8438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb925921 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa459 expref: 9 pid: 11995 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.542927:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789438288.542932:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789438288.542938:0:8438:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000761ac94b/0x7a8dd0fcbb925936 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.542949:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000761ac94b/0x7a8dd0fcbb925936 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.542972:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789438288.543033:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d055f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1274be99-2d57-4dac-a13e-a89426512ee0+9:2353:x1876361749805312:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 209us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438288.543042:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 68 00010000:00010000:0.0:1789438288.543329:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb925921 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa459 expref: 8 pid: 11995 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438288.543345:0:8192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f46e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8192:1876361769722624:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438288.543370:0:8192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000761ac94b/0x7a8dd0fcbb925936 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.543380:0:8192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000761ac94b/0x7a8dd0fcbb925936 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.543386:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000761ac94b/0x7a8dd0fcbb925936 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.543411:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000761ac94b/0x7a8dd0fcbb925936 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.543420:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000761ac94b/0x7a8dd0fcbb925936 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.543428:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000761ac94b/0x7a8dd0fcbb925936 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.543436:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55200 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:0.0:1789438288.543448:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000761ac94b/0x7a8dd0fcbb925936 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.543458:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000761ac94b/0x7a8dd0fcbb925936 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.543471:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000761ac94b/0x7a8dd0fcbb925936 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.543479:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000761ac94b/0x7a8dd0fcbb925936 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438288.543659:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1274be99-2d57-4dac-a13e-a89426512ee0+7:2353:x1876361749805184:12345-192.168.206.9@tcp:1:lhsmtool_posix.0 Request processed in 12199us (12355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438288.543668:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 57 00000100:00100000:3.0:1789438288.551169:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438288.551231:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749805568 00000100:00100000:0.0:1789438288.551242:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749805568 00000100:00100000:0.0:1789438288.551309:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 185 00000100:00100000:0.0:1789438288.551320:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f46e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+17:11515:x1876361749805568:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789438288.551403:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb92593d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.551423:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb92593d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.551437:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb92593d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.551671:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925944 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.551682:0:7624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925905 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa444 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.551691:0:7624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925944 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.551762:0:7624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925905 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa444 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.551776:0:7624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925905 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa444 expref: 18 pid: 5838 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438288.551791:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991facb2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7624:1876361769722752:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789438288.551865:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9990c1385840 going to sleep for 11 seconds 00000100:00100000:1.0:1789438288.557923:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438288.557994:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749805696 00000100:00100000:3.0:1789438288.558003:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749805696 00010000:00010000:3.0:1789438288.558058:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925905 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa444 expref: 19 pid: 5838 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438288.558099:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 69 00000100:00100000:3.0:1789438288.558108:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff999201d3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+19:2353:x1876361749805696:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789438288.558140:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438288.558147:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925905 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa444 expref: 19 pid: 5838 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.558160:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925905 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa444 expref: 19 pid: 5838 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.558231:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9991d192c700) 00010000:00010000:3.0:1789438288.558238:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925944 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.558248:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925944 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.558256:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925944 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.558275:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789438288.558329:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff999201d3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+19:2353:x1876361749805696:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 221us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438288.558337:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 69 00010000:00010000:0.0:1789438288.559118:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925905 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa444 expref: 18 pid: 5838 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438288.559144:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991facb2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7624:1876361769722752:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438288.559171:0:7624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925944 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.559181:0:7624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925944 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.559187:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925944 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789438288.559399:0:7624:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1789438288.559542:0:7624:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1789438288.559588:0:7624:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1789438288.559679:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991facb2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7624:1876361769722880:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789438288.560058:0:7624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438288.560084:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9990c1385180 going to sleep for 11 seconds 00000100:00100000:1.0:1789438288.560308:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769722880 00000100:00100000:1.0:1789438288.560315:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769722880 00000100:00100000:1.0:1789438288.560369:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789438288.560379:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7624:x1876361769722880:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789438288.560458:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7624:x1876361769722880:12345-0@lo:1000:mdt00_003.0 Request processed in 81us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438288.560465:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789438288.560966:0:7624:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1789438288.560972:0:7624:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9991c31f9500, transno 4294967315 00000100:00100000:0.0:1789438288.560991:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991facb2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7624:1876361769722880:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1789438288.562569:0:7624:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1789438288.562668:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991facb2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7624:1876361769723008:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789438288.563323:0:7624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438288.563362:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9990c1385840 going to sleep for 11 seconds 00000100:00100000:1.0:1789438288.563548:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769723008 00000100:00100000:1.0:1789438288.563556:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769723008 00000100:00100000:1.0:1789438288.563612:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789438288.563622:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7624:x1876361769723008:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789438288.563900:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7624:x1876361769723008:12345-0@lo:1000:mdt00_003.0 Request processed in 279us (578us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789438288.563908:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789438288.564672:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991facb2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7624:1876361769723008:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1789438288.564748:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925944 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.564760:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925944 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.564768:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925944 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.564775:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63c00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438288.564780:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925944 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.564788:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925944 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.564815:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9991d192c700) 00010000:00010000:0.0:1789438288.564818:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789438288.564823:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925944 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.564829:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925944 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.564868:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb925880 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.564875:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb925880 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.564881:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb925880 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.564887:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438288.564890:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb925880 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.564896:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb925880 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.564904:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d192cb00) 00010000:00010000:0.0:1789438288.564906:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789438288.564909:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb925880 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.564914:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb925880 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.564947:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92594b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.565245:0:7624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54200/0x7a8dd0fcbb92589c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa428 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.565255:0:7624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92594b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.565382:0:7624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54200/0x7a8dd0fcbb92589c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa428 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.565400:0:7624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54200/0x7a8dd0fcbb92589c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa428 expref: 21 pid: 5840 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438288.565414:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff938000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7624:1876361769723136:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789438288.565488:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9990c1385840 going to sleep for 11 seconds 00000100:00100000:2.0:1789438288.570397:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438288.570477:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749805824 00000100:00100000:1.0:1789438288.570488:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749805824 00010000:00010000:1.0:1789438288.570530:0:8438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54200/0x7a8dd0fcbb92589c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa428 expref: 22 pid: 5840 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438288.570611:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 70 00000100:00100000:1.0:1789438288.570623:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c31f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1274be99-2d57-4dac-a13e-a89426512ee0+22:2354:x1876361749805824:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789438288.570637:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438288.570645:0:8438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54200/0x7a8dd0fcbb92589c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa428 expref: 22 pid: 5840 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.570669:0:8438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54200/0x7a8dd0fcbb92589c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa428 expref: 22 pid: 5840 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.570691:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d192cb00) 00010000:00010000:1.0:1789438288.570696:0:8438:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92594b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.570735:0:8438:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92594b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.570744:0:8438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92594b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438288.570763:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438288.570827:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c31f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1274be99-2d57-4dac-a13e-a89426512ee0+22:2354:x1876361749805824:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 206us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438288.570834:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 70 00010000:00010000:0.0:1789438288.571620:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54200/0x7a8dd0fcbb92589c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa428 expref: 21 pid: 5840 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438288.571654:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff938000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7624:1876361769723136:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438288.571679:0:7624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92594b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.571689:0:7624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92594b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.571696:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92594b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.571752:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92594b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.571759:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92594b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.571766:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92594b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.571772:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63e00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438288.571777:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92594b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.571785:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92594b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.571797:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d192cb00) 00010000:00010000:0.0:1789438288.571800:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438288.571805:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92594b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.571811:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb92594b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.571822:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb92593d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.571828:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb92593d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.571834:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb92593d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.571857:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d62c00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438288.571860:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb92593d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.571867:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb92593d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.571874:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d192cb00) 00010000:00010000:0.0:1789438288.571877:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789438288.571880:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb92593d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438288.571885:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb92593d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438288.572127:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f46e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+20:11515:x1876361749805568:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 20808us (20966us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1789438288.572136:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 185 00000020:00080000:0.0:1789438288.572445:0:7624:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789438288.572734:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789438288.572739:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789438288.573428:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789438288.573439:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789438288.577177:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438288.577531:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749806080 00000100:00100000:3.0:1789438288.577541:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749806080 00000100:00100000:3.0:1789438288.577686:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 50 00000100:00100000:3.0:1789438288.577697:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d21b8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+20:11515:x1876361749806080:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789438288.579190:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789438288.579435:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1789438288.579497:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925952 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.579513:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925952 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.579524:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925952 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.579533:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925952 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.579539:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925952 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.579545:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925952 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438288.580122:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789438288.580259:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d21b8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+22:11515:x1876361749806080:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 Request processed in 2560us (3084us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1789438288.580270:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 50 00000020:00080000:2.0:1789438288.580276:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789438288.580381:0:11648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789438288.580388:0:11648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925952 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.580408:0:11648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f1c00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:3.0:1789438288.580412:0:11648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925952 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.580420:0:11648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925952 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.580434:0:11648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9991d5872c00) 00010000:00010000:3.0:1789438288.580437:0:11648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789438288.580442:0:11648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925952 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.580448:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925952 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438288.580466:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438288.580468:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438288.580469:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438288.763286:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438289.207019:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f46e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769723264:0@lo:400:kworker.0 00000100:00100000:3.0:1789438289.207032:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f46e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769723648:0@lo:400:kworker.0 00000100:00100000:0.0:1789438289.207096:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f46e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769723520:0@lo:400:kworker.0 00000100:00100000:1.0:1789438289.207143:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f46e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876361769723392:0@lo:400:kworker.0 00000100:00100000:3.0:1789438289.217169:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438289.217599:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769723648 00000100:00100000:3.0:1789438289.217609:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769723648 00000100:00100000:3.0:1789438289.217672:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789438289.217684:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f46e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769723648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438289.217761:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f46e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769723648:12345-0@lo:400:kworker.0 Request processed in 81us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438289.217769:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1789438289.217790:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789438289.217839:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1789438289.217845:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:3.0:1789438289.217866:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff999201d39f80, transno 4294967307 00000100:00100000:3.0:1789438289.217887:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f46e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769723648:0@lo:400:kworker.0 00000100:00100000:2.0:1789438289.219329:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438289.219439:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f46e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876361769723776:0@lo:400:kworker.0 00000100:00100000:2.0:1789438289.219477:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438289.219522:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769723776 00000100:00100000:2.0:1789438289.219529:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769723776 00000100:00100000:2.0:1789438289.219578:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789438289.219587:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c31f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876361769723776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438289.219661:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c31f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876361769723776:12345-0@lo:400:kworker.0 Request processed in 75us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438289.219669:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:2.0:1789438289.219688:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789438289.219730:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f46e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876361769723776:0@lo:400:kworker.0 00000100:00100000:0.0:1789438289.226729:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438289.226926:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438289.226959:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f46e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769723904:0@lo:400:kworker.0 00000100:00100000:1.0:1789438289.226990:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438289.227032:0:11995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769723904 00000100:00100000:1.0:1789438289.227041:0:11995:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769723904 00000100:00100000:1.0:1789438289.227087:0:11995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789438289.227096:0:11995:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff999201d38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3310:x1876361769723904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438289.227147:0:11995:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff999201d38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3310:x1876361769723904:12345-0@lo:400:kworker.0 Request processed in 51us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438289.227154:0:11995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789438289.227200:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769723264 00000100:00100000:3.0:1789438289.227206:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769723264 00000100:00100000:3.0:1789438289.227239:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789438289.227246:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3309:x1876361769723264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438289.227284:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3309:x1876361769723264:12345-0@lo:400:kworker.0 Request processed in 39us (7962us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438289.227289:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1789438289.227608:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769723520 00000100:00100000:0.0:1789438289.227613:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769723520 00000100:00100000:0.0:1789438289.227660:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769723392 00000100:00100000:0.0:1789438289.227663:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769723392 00000100:00100000:0.0:1789438289.227678:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789438289.227685:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769723520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438289.227738:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769723520:12345-0@lo:400:kworker.0 Request processed in 54us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438289.227759:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789438289.227774:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789438289.227779:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff999201d39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876361769723392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438289.227816:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff999201d39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876361769723392:12345-0@lo:400:kworker.0 Request processed in 36us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438289.227821:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789438289.227864:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f46e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769723520:0@lo:400:kworker.0 00000100:00080000:3.0:1789438289.227897:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789438289.227907:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f46e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769723904:0@lo:400:kworker.0 00000100:00100000:0.0:1789438289.227926:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f46e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876361769723392:0@lo:400:kworker.0 00000100:00100000:2.0:1789438289.228453:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f46e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769723264:0@lo:400:kworker.0 00000100:00100000:3.0:1789438289.718971:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789438289.718997:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff999201d3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769724032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789438289.719087:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438289.722258:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769724032 00000100:00100000:1.0:1789438289.722275:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769724032 00000100:00100000:1.0:1789438289.722340:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789438289.722350:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f46e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876361769724032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789438289.722375:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1789438289.722448:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f46e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876361769724032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (3361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438289.722455:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789438289.722628:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789438289.722648:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c31f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769724160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789438289.722693:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438289.722763:0:10069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769724160 00000100:00100000:0.0:1789438289.722768:0:10069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769724160 00000100:00100000:0.0:1789438289.722792:0:10069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789438289.722798:0:10069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769724160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789438289.722822:0:10069:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438289.722855:0:10069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769724160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438289.722861:0:10069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789438289.722907:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c31f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769724160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789438289.722948:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff999201d3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769724032:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789438289.791449:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789438290.141894:0:12493:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789438290.141905:0:12493:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789438290.142041:0:12493:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1789438290.142053:0:12493:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789438290.332541:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438290.332613:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749806336 00000100:00100000:1.0:1789438290.332625:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749806336 00000100:00100000:1.0:1789438290.332703:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 186 00000100:00100000:1.0:1789438290.332736:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f46e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+22:11533:x1876361749806336:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438290.332762:0:7624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438290.332784:0:7624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb925959 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa460 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.332888:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb925960 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.332904:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb925960 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.332917:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb925960 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438290.332928:0:7624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789438290.333061:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb925959 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa460 expref: 25 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.333081:0:7624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb925960 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa460 expref: 24 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.333090:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:1.0:1789438290.333093:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789438290.333097:0:7624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9db400, rc 0) 00000100:00100000:1.0:1789438290.333151:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f46e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+24:11533:x1876361749806336:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 417us (619us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1789438290.333173:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 186 00000100:00080000:3.0:1789438290.333404:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789438290.346646:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438290.346747:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749806464 00000100:00100000:2.0:1789438290.346759:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749806464 00000100:00100000:2.0:1789438290.346816:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 187 00000100:00100000:2.0:1789438290.346827:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+24:11533:x1876361749806464:12345-192.168.206.9@tcp:34:lfs.0 00010000:00010000:2.0:1789438290.346916:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92596e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.346934:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92596e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.346947:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92596e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.346963:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925975 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.346969:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.346975:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.347232:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb92597c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.347247:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb92597c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.347254:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb92597c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789438290.347298:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb92597c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.347310:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92596e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.347317:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92596e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.347324:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92596e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.347330:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f1800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438290.347334:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92596e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.347343:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92596e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.347355:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:2.0:1789438290.347358:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438290.347363:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92596e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.347370:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb92596e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.347388:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.347394:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925975 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.347399:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925975 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.347404:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f1400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438290.347407:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925975 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.347413:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925975 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.347420:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9991d5872700) 00010000:00010000:2.0:1789438290.347422:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438290.347425:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925975 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.347430:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925975 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.347443:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb92597c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.347448:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb92597c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.347453:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb92597c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.347464:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f1000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438290.347466:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb92597c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.347472:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb92597c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.347480:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991d5872b00) 00010000:00010000:2.0:1789438290.347482:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438290.347484:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb92597c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.347490:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb92597c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438290.347564:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+24:11533:x1876361749806464:12345-192.168.206.9@tcp:34:lfs.0 Request processed in 738us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438290.347572:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 187 00000100:00100000:2.0:1789438290.444246:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438290.444318:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749806720 00000100:00100000:1.0:1789438290.444328:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749806720 00000100:00100000:1.0:1789438290.444387:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 188 00000100:00100000:1.0:1789438290.444399:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c31fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+24:11536:x1876361749806720:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438290.444420:0:7624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438290.444442:0:7624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb925983 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa467 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.444520:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb92598a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.444537:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb92598a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.444549:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb92598a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.444565:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925991 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.444578:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925991 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.444584:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925991 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.445701:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925998 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.446336:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925998 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.446347:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925998 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438290.446361:0:7624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789438290.446468:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb92598a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.446477:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb92598a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.446484:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb92598a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.446490:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dbe00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438290.446495:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb92598a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.446502:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb92598a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.446514:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:1.0:1789438290.446517:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438290.446522:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb92598a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.446529:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb92598a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.446542:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925991 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.446554:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925991 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.446559:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925991 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.446565:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9da600 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438290.446568:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925991 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.446574:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925991 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.446581:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9991c7c83900) 00010000:00010000:1.0:1789438290.446583:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438290.446586:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925991 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.446591:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925991 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.446636:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da000/0x7a8dd0fcbb925983 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa467 expref: 27 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.446650:0:7624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925998 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa467 expref: 26 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.446657:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991c7c83d00) 00010000:00010000:1.0:1789438290.446659:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789438290.446668:0:7624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9dae00, rc 0) 00000100:00100000:1.0:1789438290.446768:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c31fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+26:11536:x1876361749806720:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 2370us (2529us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1789438290.446777:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 188 00000100:00100000:2.0:1789438290.457978:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438290.458041:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749806848 00000100:00100000:3.0:1789438290.458052:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749806848 00000100:00100000:3.0:1789438290.458407:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 189 00000100:00100000:3.0:1789438290.458417:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c31f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+26:11536:x1876361749806848:12345-192.168.206.9@tcp:54:lfs.0 00010000:00010000:3.0:1789438290.458492:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9259a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.458509:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9259a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.458521:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9259a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.458563:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9259a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.458569:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9259a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.458576:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9259a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.458581:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438290.458585:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9259a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.458592:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9259a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.458603:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991c7c83d00) 00010000:00010000:3.0:1789438290.458606:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789438290.458610:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9259a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.458615:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb9259a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438290.458704:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c31f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+26:11536:x1876361749806848:12345-192.168.206.9@tcp:54:lfs.0 Request processed in 288us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438290.458754:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 189 00000100:00100000:0.0:1789438290.463831:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438290.464345:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749807104 00000100:00100000:2.0:1789438290.464357:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749807104 00000100:00100000:2.0:1789438290.464416:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 51 00000100:00100000:2.0:1789438290.464426:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+26:11536:x1876361749807104:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:2.0:1789438290.464674:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+27:11536:x1876361749807104:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 249us (852us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1789438290.464682:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 51 00000100:00100000:2.0:1789438290.522091:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438290.522189:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749807360 00000100:00100000:0.0:1789438290.522199:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749807360 00000100:00100000:0.0:1789438290.522263:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 190 00000100:00100000:0.0:1789438290.522274:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa7cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+27:11062:x1876361749807360:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:0.0:1789438290.522297:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438290.522317:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9259ad lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa46e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.522704:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb9259b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.522772:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925998 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa467 expref: 28 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.522781:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb9259b4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.522817:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925998 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa467 expref: 28 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.522832:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925998 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa467 expref: 28 pid: 7624 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438290.522846:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff938a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876361769724288:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789438290.523069:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fabaa0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789438290.527991:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff938a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876361769724288:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438290.528036:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb9259b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438290.530916:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438290.531688:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749807488 00000100:00100000:3.0:1789438290.531701:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749807488 00010000:00010000:3.0:1789438290.531770:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925998 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa467 expref: 29 pid: 7624 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438290.531828:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 71 00000100:00100000:3.0:1789438290.531837:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+29:2354:x1876361749807488:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789438290.531853:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438290.531860:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925998 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa467 expref: 29 pid: 7624 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.531873:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925998 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa467 expref: 29 pid: 7624 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.531895:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925998 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa467 expref: 29 pid: 7624 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.531912:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991c7c83d00) 00010000:00010000:3.0:1789438290.531917:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb9259b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.531986:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb9259b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.531995:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb9259b4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.532078:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789438290.532150:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+28:2354:x1876361749807488:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 313us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438290.532158:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 71 00010000:00010000:0.0:1789438290.538033:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb9259b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.538052:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb9259b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438290.538080:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789438290.538860:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9259ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa46e expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.538888:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb9259b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa46e expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.538899:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991c7c83d00) 00010000:00010000:1.0:1789438290.538903:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789438290.538907:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63600, rc 0) 00000100:00100000:1.0:1789438290.539032:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa7cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+28:11062:x1876361749807360:12345-192.168.206.9@tcp:101:bash.0 Request processed in 16757us (16947us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1789438290.539042:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 190 00000100:00100000:2.0:1789438290.545338:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438290.545435:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749807744 00000100:00100000:0.0:1789438290.545445:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749807744 00000100:00100000:0.0:1789438290.545509:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 191 00000100:00100000:0.0:1789438290.545521:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+28:11062:x1876361749807744:12345-192.168.206.9@tcp:36:bash.0 00010000:00010000:0.0:1789438290.545877:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9259c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.545896:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9259c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.545908:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9259c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789438290.545962:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1789438290.545987:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c28c3ee reply state 00000000eed499f7 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9259c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438290.545997:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789438290.546058:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1789438290.546353:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+32:11062:x1876361749807744:12345-192.168.206.9@tcp:36:bash.0 Request processed in 832us (1021us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1789438290.546361:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 191 00000020:00080000:0.0:1789438290.546367:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1789438290.552101:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9259c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.552131:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9259c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.552142:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9259c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.552149:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438290.552155:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9259c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.552164:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9259c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.552209:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991c7c83d00) 00010000:00010000:1.0:1789438290.552213:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438290.552222:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9259c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.552229:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9259c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438290.552973:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438290.553259:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749807872 00000100:00100000:1.0:1789438290.553269:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749807872 00000100:00100000:1.0:1789438290.553328:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 192 00000100:00100000:1.0:1789438290.553339:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+31:11062:x1876361749807872:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:1.0:1789438290.553363:0:7624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438290.553381:0:7624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb9259c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa475 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.553438:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb9259c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa475 expref: 32 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.553454:0:7624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb9259c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa475 expref: 32 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.553473:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991c7c83d00) 00010000:00010000:1.0:1789438290.553476:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789438290.553479:0:7624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9dac00, rc 0) 00000100:00100000:1.0:1789438290.553539:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+32:11062:x1876361749807872:12345-192.168.206.9@tcp:101:bash.0 Request processed in 202us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438290.553546:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 192 00000100:00100000:2.0:1789438290.567140:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438290.567283:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749808000 00000100:00100000:0.0:1789438290.567294:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749808000 00000100:00100000:0.0:1789438290.567379:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 58 00000100:00100000:0.0:1789438290.567392:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1274be99-2d57-4dac-a13e-a89426512ee0+7:11062:x1876361749808000:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:0.0:1789438290.567413:0:8192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438290.567438:0:8192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000739958eb/0x7a8dd0fcbb9259d0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa47c expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789438290.567466:0:8192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa8a94e, atime: 0x6aa8a94d, ctime: 0x6aa8a94e, blocks: 0xb 00010000:00010000:0.0:1789438290.567492:0:8192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=342s v=(0 0) 00010000:00010000:0.0:1789438290.567496:0:8192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789438290.567504:0:8192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000739958eb/0x7a8dd0fcbb9259d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa47c expref: 8 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.567521:0:8192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000739958eb/0x7a8dd0fcbb9259d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa47c expref: 8 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.567534:0:8192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d62200, rc 0) 00000100:00100000:0.0:1789438290.567645:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1274be99-2d57-4dac-a13e-a89426512ee0+8:11062:x1876361749808000:12345-192.168.206.9@tcp:101:bash.0 Request processed in 256us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438290.567652:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 58 00000100:00080000:3.0:1789438290.567727:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789438290.573094:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438290.573289:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749808128 00000100:00100000:1.0:1789438290.573298:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749808128 00002000:00010000:1.0:1789438290.573344:0:6687:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1789438290.573349:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9991f46e4380 with x1876361749808128 ext(0->18446744073709551615) 00002000:00010000:1.0:1789438290.573362:0:6687:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9991f46e4380. 00000100:00100000:1.0:1789438290.573401:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 5 00000100:00100000:1.0:1789438290.573412:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f46e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1274be99-2d57-4dac-a13e-a89426512ee0+8:2354:x1876361749808128:12345-192.168.206.9@tcp:10:bash.0 00002000:00010000:1.0:1789438290.573995:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789438290.574009:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789438286 -> 1789438290 00002000:00010000:1.0:1789438290.574013:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789438285 -> 1789438285 00002000:00010000:1.0:1789438290.574015:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789438286 -> 1789438290 00002000:00010000:1.0:1789438290.574017:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789438290.574086:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f46e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1274be99-2d57-4dac-a13e-a89426512ee0+9:2354:x1876361749808128:12345-192.168.206.9@tcp:10:bash.0 Request processed in 675us (1001us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789438290.574094:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 5 00002000:00010000:1.0:1789438290.574098:0:6687:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1789438290.574101:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9991f46e4380 with x1876361749808128 ext(0->18446744073709551615) 00002000:00010000:1.0:1789438290.574106:0:6687:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9991f46e4380. 00000100:00100000:1.0:1789438290.667381:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438290.667498:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749808256 00000100:00100000:0.0:1789438290.667512:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749808256 00000100:00100000:0.0:1789438290.667585:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 193 00000100:00100000:0.0:1789438290.667598:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff999201d3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+32:11550:x1876361749808256:12345-192.168.206.9@tcp:34:lfs.0 00010000:00010000:0.0:1789438290.667758:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9259d7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.667786:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9259d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.667801:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9259d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.667819:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9259de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.667827:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9259de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.667834:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9259de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.668234:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9259e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.668245:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9259e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.668254:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9259e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789438290.668309:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9259e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.668324:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9259d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.668331:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9259d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.668350:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9259d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.668356:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438290.668361:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9259d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.668369:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9259d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.668384:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:0.0:1789438290.668387:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438290.668394:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9259d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.668401:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb9259d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.668416:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9259de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.668424:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9259de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.668430:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9259de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.668436:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438290.668439:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9259de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.668454:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9259de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.668463:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9991c3ac2100) 00010000:00010000:0.0:1789438290.668465:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438290.668468:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9259de lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.668475:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb9259de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.668490:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9259e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.668496:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9259e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.668500:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9259e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.668505:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438290.668507:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9259e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.668513:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9259e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.668518:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991c7c83d00) 00010000:00010000:0.0:1789438290.668521:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438290.668523:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9259e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.668535:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9259e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438290.668617:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff999201d3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+32:11550:x1876361749808256:12345-192.168.206.9@tcp:34:lfs.0 Request processed in 1020us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438290.668625:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 193 00000100:00100000:3.0:1789438290.726149:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438290.726274:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749808512 00000100:00100000:1.0:1789438290.726287:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749808512 00000100:00100000:1.0:1789438290.726427:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 194 00000100:00100000:1.0:1789438290.726440:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f46e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+32:11553:x1876361749808512:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438290.726469:0:7624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438290.726494:0:7624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9259ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa483 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.726613:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9259f3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.726631:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9259f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.726644:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9259f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.726661:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9259fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.726668:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9259fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.726675:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9259fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.727496:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925a01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.727512:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925a01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.727520:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925a01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438290.727534:0:7624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789438290.727644:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9259f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.727652:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9259f3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.727667:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9259f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.727674:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9da200 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438290.727678:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9259f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.727769:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9259f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.728464:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:1.0:1789438290.728470:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438290.728476:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9259f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.728485:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb9259f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.728502:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9259fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.728509:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9259fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.728516:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9259fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.728522:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dbe00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438290.728525:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9259fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.728545:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9259fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.728554:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9991c7c83900) 00010000:00010000:1.0:1789438290.728556:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438290.728560:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9259fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.728566:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb9259fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.728630:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb9259ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa483 expref: 35 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.728647:0:7624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925a01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa483 expref: 34 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438290.728655:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991c7c83d00) 00010000:00010000:1.0:1789438290.728658:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789438290.728661:0:7624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9dae00, rc 0) 00000100:00100000:1.0:1789438290.731027:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f46e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+34:11553:x1876361749808512:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 4565us (4887us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1789438290.731042:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 194 00000100:00100000:0.0:1789438290.745659:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438290.747884:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749808640 00000100:00100000:3.0:1789438290.747902:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749808640 00000100:00100000:3.0:1789438290.747997:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 195 00000100:00100000:3.0:1789438290.748020:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+34:11553:x1876361749808640:12345-192.168.206.9@tcp:54:lfs.0 00010000:00010000:3.0:1789438290.748113:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb925a0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.748136:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb9259b4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa46e expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.748147:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb925a0f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.748205:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb9259b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa46e expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.748223:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb9259b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa46e expref: 34 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438290.748241:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f46e5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876361769724416:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789438290.749906:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d019c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438290.753143:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f46e5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876361769724416:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789438290.753270:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb925a0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438290.755430:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438290.755665:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749808896 00000100:00100000:3.0:1789438290.755692:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749808896 00000100:00100000:3.0:1789438290.755780:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 52 00000100:00100000:3.0:1789438290.755792:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+35:5592:x1876361749808896:12345-192.168.206.9@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789438290.756242:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+36:5592:x1876361749808896:12345-192.168.206.9@tcp:35:ldlm_bl.0 Request processed in 451us (821us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1789438290.756252:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 52 00000100:00100000:0.0:1789438290.759293:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438290.759393:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749809024 00000100:00100000:3.0:1789438290.759404:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749809024 00010000:00010000:3.0:1789438290.759446:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb9259b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa46e expref: 36 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438290.759526:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 72 00000100:00100000:3.0:1789438290.759537:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff93a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+36:2354:x1876361749809024:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789438290.759581:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438290.759590:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb9259b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa46e expref: 36 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.759605:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb9259b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa46e expref: 36 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.759633:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb9259b4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa46e expref: 36 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.759651:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991c7c83d00) 00010000:00010000:3.0:1789438290.759657:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb925a0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.759665:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb925a0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.759680:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb925a0f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.759755:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789438290.759810:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff93a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+35:2354:x1876361749809024:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 275us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438290.759818:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 72 00010000:00010000:2.0:1789438290.759890:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb925a0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.759900:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb925a0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.759942:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb925a0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.759951:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb925a0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.759958:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb925a0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.759964:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438290.759969:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb925a0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.759977:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb925a0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.759987:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991c7c83d00) 00010000:00010000:2.0:1789438290.759990:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789438290.759994:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb925a0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.760010:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb925a0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438290.760056:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+34:11553:x1876361749808640:12345-192.168.206.9@tcp:54:lfs.0 Request processed in 12039us (14414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438290.760064:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 195 00000100:00100000:1.0:1789438290.762624:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438290.762770:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749809280 00000100:00100000:3.0:1789438290.762780:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749809280 00000100:00100000:3.0:1789438290.762875:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 53 00000100:00100000:3.0:1789438290.762887:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff999201d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+34:11553:x1876361749809280:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:3.0:1789438290.763275:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff999201d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+35:11553:x1876361749809280:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 390us (658us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789438290.763283:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 53 00010000:00010000:3.0:1789438290.806956:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438290.845467:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438290.845747:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749809536 00000100:00100000:2.0:1789438290.845759:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749809536 00000100:00100000:2.0:1789438290.845823:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 196 00000100:00100000:2.0:1789438290.845847:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+35:11564:x1876361749809536:12345-192.168.206.9@tcp:101:cat.0 00010000:00010000:2.0:1789438290.845876:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438290.845898:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925a16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa48a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.846110:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925a1d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.846136:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925a1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.846149:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925a1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.846164:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb925a24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.846171:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb925a24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.846177:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb925a24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.846448:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb925a2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.846458:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb925a2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.846464:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb925a2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438290.846475:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1789438290.846567:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925a1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.846575:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925a1d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.846582:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925a1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.846589:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f1400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438290.846593:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925a1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.846601:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925a1d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.846613:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:2.0:1789438290.846616:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438290.846621:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925a1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.846637:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925a1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.846650:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb925a24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.846656:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb925a24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.846662:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb925a24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.846668:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f1000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438290.846671:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb925a24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.846676:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb925a24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.846684:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9991d5872b00) 00010000:00010000:2.0:1789438290.846686:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438290.846689:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb925a24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.846693:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb925a24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.846778:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925a16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa48a expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.846793:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb925a2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa48a expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.846807:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991c7c83d00) 00010000:00010000:2.0:1789438290.846809:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789438290.846811:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f0a00, rc 0) 00000100:00100000:2.0:1789438290.846879:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+37:11564:x1876361749809536:12345-192.168.206.9@tcp:101:cat.0 Request processed in 1044us (1421us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1789438290.846887:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 196 00000100:00100000:1.0:1789438290.852414:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438290.852510:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749809792 00000100:00100000:0.0:1789438290.852520:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749809792 00000100:00100000:0.0:1789438290.852582:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 54 00000100:00100000:0.0:1789438290.852593:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff999201d39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+37:11564:x1876361749809792:12345-192.168.206.9@tcp:35:cat.0 00000100:00100000:0.0:1789438290.852889:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff999201d39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+38:11564:x1876361749809792:12345-192.168.206.9@tcp:35:cat.0 Request processed in 297us (485us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789438290.852898:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 54 00000100:00100000:1.0:1789438290.870624:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438290.870735:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749810048 00000100:00100000:0.0:1789438290.870747:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749810048 00000100:00100000:0.0:1789438290.870811:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 197 00000100:00100000:0.0:1789438290.870823:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff999201d3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+38:11565:x1876361749810048:12345-192.168.206.9@tcp:36:rm.0 00010000:00010000:0.0:1789438290.870915:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789438290.870957:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb925a2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa48a expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.870977:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925a01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa483 expref: 37 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.870997:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dac00/0x7a8dd0fcbb9259c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa475 expref: 36 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.871018:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991c7c83d00) 00010000:00010000:0.0:1789438290.871028:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789438290.871048:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925a39 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.871062:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925a39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.871070:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925a39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.871083:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925a40 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.871090:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925a40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.871096:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925a40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.871337:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925a47 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.871345:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925a47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.871352:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925a47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789438290.871937:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1789438290.871947:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 343137238234ns, next at 344137236146ns, rc = 0 00010000:00010000:0.0:1789438290.872016:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925a4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.872027:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925a4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.872035:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925a4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.872043:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925a4e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.872049:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925a4e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.872055:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925a4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.872084:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789438290.872102:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925a47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.872108:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925a47 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.872115:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925a47 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.872121:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63e00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438290.872131:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925a47 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.872139:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925a47 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.872148:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991c3ac2700) 00010000:00010000:0.0:1789438290.872151:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789438290.872155:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925a47 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.872183:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925a47 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.872197:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925a39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.872203:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925a39 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.872208:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925a39 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.872214:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438290.872216:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925a39 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.872222:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925a39 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.872230:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:0.0:1789438290.872232:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438290.872241:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925a39 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.872246:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925a39 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789438290.872256:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003806b71a reply state 00000000fb843aa5 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925a40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438290.872264:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789438290.872335:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff999201d3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+37:11565:x1876361749810048:12345-192.168.206.9@tcp:36:rm.0 Request processed in 1512us (1718us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1789438290.872342:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 197 00010000:00010000:3.0:1789438290.872564:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789438290.872570:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925a4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.872576:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d62c00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:3.0:1789438290.872579:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925a4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.872585:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925a4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.872593:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9991c3ac2700) 00010000:00010000:3.0:1789438290.872595:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789438290.872605:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925a4e lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.872610:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925a4e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.872623:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438290.872625:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438290.872627:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438290.875381:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925a40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.875396:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925a40 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.875404:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925a40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.875409:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63a00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438290.875413:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925a40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.875420:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925a40 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.875435:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9991c3ac2100) 00010000:00010000:2.0:1789438290.875437:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438290.875442:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925a40 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.875447:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925a40 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438290.914060:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438290.914326:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749810304 00000100:00100000:0.0:1789438290.914336:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749810304 00000100:00100000:0.0:1789438290.914405:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 198 00000100:00100000:0.0:1789438290.914416:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff999201d3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+36:11571:x1876361749810304:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:0.0:1789438290.914443:0:7624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438290.914464:0:7624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925a55 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa491 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.914653:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925a5c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.914669:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925a5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.914680:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925a5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.914695:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925a63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.914802:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925a63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.914810:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925a63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789438290.915602:0:7624:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1789438290.916192:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925a6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.916207:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925a6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.916216:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925a6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.916252:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925a5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.916260:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925a5c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.916268:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925a5c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.916274:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63e00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438290.916278:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925a5c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.916285:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925a5c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.916311:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:0.0:1789438290.916314:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438290.916319:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925a5c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.916324:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925a5c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789438290.916337:0:7624:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ccb77f8 reply state 000000009be231fe transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925a63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438290.916346:0:7624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789438290.916375:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925a55 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa491 expref: 39 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.916389:0:7624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925a6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa491 expref: 38 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.916396:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c3ac2500) 00010000:00010000:0.0:1789438290.916398:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789438290.916400:0:7624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63200, rc 0) 00000100:00100000:0.0:1789438290.916475:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff999201d3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+39:11571:x1876361749810304:12345-192.168.206.9@tcp:101:bash.0 Request processed in 2061us (2425us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1789438290.916483:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 198 00010000:00010000:2.0:1789438290.919176:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925a63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.919193:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925a63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.919201:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925a63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.919207:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63c00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438290.919212:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925a63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.919220:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925a63 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.919237:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9991c3ac2f00) 00010000:00010000:2.0:1789438290.919240:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438290.919245:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925a63 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.919252:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925a63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438290.921763:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438290.922376:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749810432 00000100:00100000:3.0:1789438290.922387:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749810432 00000100:00100000:3.0:1789438290.922507:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 59 00000100:00100000:3.0:1789438290.922519:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff999201d39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1274be99-2d57-4dac-a13e-a89426512ee0+5:2355:x1876361749810432:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:3.0:1789438290.922538:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438290.922560:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d092743b/0x7a8dd0fcbb925a78 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa498 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789438290.922587:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789438290.922606:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=343s v=(0 0) 00010000:00010000:3.0:1789438290.922611:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438290.922620:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d092743b/0x7a8dd0fcbb925a78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa498 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.922640:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d092743b/0x7a8dd0fcbb925a78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa498 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.922652:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a55e00, rc 0) 00000100:00100000:3.0:1789438290.922740:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff999201d39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1274be99-2d57-4dac-a13e-a89426512ee0+6:2355:x1876361749810432:12345-192.168.206.9@tcp:101:bash.0 Request processed in 223us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438290.922759:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 59 00000100:00080000:2.0:1789438290.928306:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789438290.929156:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438290.929235:0:11995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749810560 00000100:00100000:2.0:1789438290.929245:0:11995:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749810560 00000100:00100000:2.0:1789438290.929306:0:11995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 60 00000100:00100000:2.0:1789438290.929318:0:11995:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff999201d38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1274be99-2d57-4dac-a13e-a89426512ee0+6:11571:x1876361749810560:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:2.0:1789438290.929336:0:11995:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438290.929366:0:11995:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1fa71db/0x7a8dd0fcbb925a7f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa49f expref: -99 pid: 11995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.929398:0:11995:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d092743b/0x7a8dd0fcbb925a78 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa498 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.929407:0:11995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789438290.929410:0:11995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789438290.929416:0:11995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1fa71db/0x7a8dd0fcbb925a7f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa49f expref: 7 pid: 11995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.929451:0:11995:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d092743b/0x7a8dd0fcbb925a78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa498 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438290.929465:0:11995:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d092743b/0x7a8dd0fcbb925a78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa498 expref: 7 pid: 6681 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438290.929480:0:11995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff951c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11995:1876361769724544:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789438290.929568:0:11995:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fa9f1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789438290.932315:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438290.932412:0:11995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff951c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11995:1876361769724544:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789438290.932446:0:11995:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b1fa71db/0x7a8dd0fcbb925a7f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa49f expref: 7 pid: 11995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438290.932466:0:11995:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f1800, rc 0) 00000100:00100000:3.0:1789438290.932528:0:11995:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff999201d38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1274be99-2d57-4dac-a13e-a89426512ee0+7:11571:x1876361749810560:12345-192.168.206.9@tcp:101:bash.0 Request processed in 3213us (3378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438290.932537:0:11995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 60 00000100:00100000:0.0:1789438290.933250:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749810688 00000100:00100000:0.0:1789438290.933258:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749810688 00010000:00010000:0.0:1789438290.933296:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d092743b/0x7a8dd0fcbb925a78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa498 expref: 7 pid: 6681 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438290.933355:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 73 00000100:00100000:0.0:1789438290.933364:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff950380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+7:2353:x1876361749810688:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789438290.933379:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438290.933400:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d092743b/0x7a8dd0fcbb925a78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa498 expref: 7 pid: 6681 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.933413:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d092743b/0x7a8dd0fcbb925a78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa498 expref: 7 pid: 6681 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.933435:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d092743b/0x7a8dd0fcbb925a78 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa498 expref: 7 pid: 6681 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.933449:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789438290.933452:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789438290.933459:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b1fa71db/0x7a8dd0fcbb925a7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa49f expref: 6 pid: 11995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.933468:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1fa71db/0x7a8dd0fcbb925a7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa49f expref: 6 pid: 11995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438290.933504:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b1fa71db/0x7a8dd0fcbb925a7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa49f expref: 6 pid: 11995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438290.933518:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff938700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5824:1876361769724672:192.168.206.9@tcp:105: 00000100:00100000:0.0:1789438290.933594:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fabaa300 going to sleep for 11 seconds 00000100:00100000:0.0:1789438290.936551:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff938700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5824:1876361769724672:192.168.206.9@tcp:105: 00010000:00010000:0.0:1789438290.936585:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438290.936640:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff950380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+6:2353:x1876361749810688:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 3276us (4334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438290.936651:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 73 00000100:00100000:3.0:1789438290.939137:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438290.939205:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749810944 00000100:00100000:0.0:1789438290.939215:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749810944 00000100:00100000:0.0:1789438290.939274:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 55 00000100:00100000:0.0:1789438290.939286:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f46e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+38:11571:x1876361749810944:12345-192.168.206.9@tcp:35:bash.0 00000100:00100000:0.0:1789438290.939605:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f46e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+39:11571:x1876361749810944:12345-192.168.206.9@tcp:35:bash.0 Request processed in 321us (482us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1789438290.939613:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 55 00000100:00100000:2.0:1789438291.110828:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438291.110949:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749811072 00000100:00100000:0.0:1789438291.110961:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749811072 00000100:00100000:0.0:1789438291.111042:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 199 00000100:00100000:0.0:1789438291.111054:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+39:11587:x1876361749811072:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:0.0:1789438291.111083:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438291.111108:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925a86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa4a6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.111200:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925a8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.111215:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925a8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.111247:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925a8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438291.111287:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789438291.111291:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789438291.111308:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925a8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.111334:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925a86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4a6 expref: 41 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.111357:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925a8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4a6 expref: 40 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.111366:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:0.0:1789438291.111369:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789438291.111373:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63e00, rc 0) 00000100:00100000:0.0:1789438291.111805:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+40:11587:x1876361749811072:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 751us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438291.111812:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 199 00000100:00100000:2.0:1789438291.117906:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438291.118069:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749811328 00000100:00100000:1.0:1789438291.118083:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749811328 00000100:00100000:1.0:1789438291.118144:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 200 00000100:00100000:1.0:1789438291.118157:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+40:11587:x1876361749811328:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438291.118181:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438291.118205:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925a94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa4ad expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.118345:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb925a9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.118360:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb925a9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.118371:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb925a9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438291.118382:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789438291.118511:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da600/0x7a8dd0fcbb925a94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4ad expref: 43 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.118531:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb925a9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4ad expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.118540:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c3ac2500) 00010000:00010000:1.0:1789438291.118543:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789438291.118547:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9da200, rc 0) 00000100:00100000:1.0:1789438291.118619:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+42:11587:x1876361749811328:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 465us (727us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1789438291.118636:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 200 00000100:00100000:3.0:1789438291.122243:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438291.122288:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438291.122377:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749811712 00000100:00100000:2.0:1789438291.122388:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749811712 00000100:00100000:2.0:1789438291.122472:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 201 00000100:00100000:2.0:1789438291.122483:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f46e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+42:11587:x1876361749811712:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789438291.122510:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438291.122544:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925aa9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa4b4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.122647:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925ab0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.122663:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925ab0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.122676:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925ab0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438291.122688:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789438291.122885:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925aa9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4b4 expref: 45 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.122908:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925ab0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4b4 expref: 44 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.122916:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c3ac2500) 00010000:00010000:2.0:1789438291.122919:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789438291.122923:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f1c00, rc 0) 00000100:00100000:2.0:1789438291.122992:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f46e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+44:11587:x1876361749811712:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 511us (702us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1789438291.123012:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 201 00000100:00100000:1.0:1789438291.123952:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749811456 00000100:00100000:1.0:1789438291.123961:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749811456 00000100:00100000:1.0:1789438291.124024:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:1.0:1789438291.124033:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f46e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1274be99-2d57-4dac-a13e-a89426512ee0+44:2354:x1876361749811456:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789438291.124045:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438291.124063:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb925a9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4ad expref: 44 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.124078:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c3ac2500) 00010000:00010000:1.0:1789438291.124082:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438291.124318:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f46e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1274be99-2d57-4dac-a13e-a89426512ee0+43:2354:x1876361749811456:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 285us (2085us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438291.124326:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:3.0:1789438291.131863:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438291.132330:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749811840 00000100:00100000:2.0:1789438291.132340:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749811840 00000100:00100000:2.0:1789438291.132409:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 61 00000100:00100000:2.0:1789438291.132421:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f46e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+6:2356:x1876361749811840:12345-192.168.206.9@tcp:1:lfs.0 00010000:00010000:2.0:1789438291.132502:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008accc994/0x7a8dd0fcbb925abe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.132524:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b1fa71db/0x7a8dd0fcbb925a7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa49f expref: 6 pid: 11995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.132534:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789438291.132538:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789438291.132543:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008accc994/0x7a8dd0fcbb925abe lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.132587:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b1fa71db/0x7a8dd0fcbb925a7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa49f expref: 6 pid: 11995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.132604:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b1fa71db/0x7a8dd0fcbb925a7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa49f expref: 6 pid: 11995 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438291.132620:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d04b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1876361769724800:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789438291.132744:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fa9f1600 going to sleep for 11 seconds 00000100:00100000:2.0:1789438291.142595:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d04b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1876361769724800:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789438291.142628:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008accc994/0x7a8dd0fcbb925abe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438291.144742:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438291.147342:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749811968 00000100:00100000:1.0:1789438291.147359:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749811968 00002000:00100000:1.0:1789438291.147884:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9991f46e5500 x1876361749811968/t0(0) o4->1274be99-2d57-4dac-a13e-a89426512ee0@192.168.206.9@tcp:722/0 lens 504/0 e 0 to 0 dl 1789438302 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789438291.147896:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9991f46e5500 with x1876361749811968 ext(0->8) 00010000:00010000:1.0:1789438291.147906:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b1fa71db/0x7a8dd0fcbb925a7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa49f expref: 7 pid: 11995 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.148187:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b1fa71db/0x7a8dd0fcbb925a7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa49f expref: 7 pid: 11995 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789438291.148199:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9991f46e5500 00000100:00100000:1.0:1789438291.148327:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 3 00000100:00100000:1.0:1789438291.148340:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f46e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1274be99-2d57-4dac-a13e-a89426512ee0+7:2353:x1876361749811968:12345-192.168.206.9@tcp:4:lfs.0 00000100:00100000:1.0:1789438291.148940:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f46e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1274be99-2d57-4dac-a13e-a89426512ee0+9:2353:x1876361749811968:12345-192.168.206.9@tcp:4:lfs.0 Request processed in 590us (4232us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789438291.148949:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 3 00002000:00100000:1.0:1789438291.148957:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9991f46e5500 x1876361749811968/t4294967308(0) o4->1274be99-2d57-4dac-a13e-a89426512ee0@192.168.206.9@tcp:722/0 lens 504/448 e 0 to 0 dl 1789438302 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789438291.148966:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9991f46e5500 with x1876361749811968 ext(0->8) 00010000:00010000:1.0:1789438291.148973:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b1fa71db/0x7a8dd0fcbb925a7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa49f expref: 9 pid: 11995 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.148987:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b1fa71db/0x7a8dd0fcbb925a7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa49f expref: 9 pid: 11995 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789438291.148994:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9991f46e5500 00000100:00100000:2.0:1789438291.154364:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438291.154510:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749812096 00000100:00100000:3.0:1789438291.154522:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749812096 00010000:00010000:3.0:1789438291.154562:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b1fa71db/0x7a8dd0fcbb925a7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa49f expref: 9 pid: 11995 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438291.154646:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 74 00000100:00100000:3.0:1789438291.154656:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d055c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+9:2355:x1876361749812096:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789438291.154671:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789438291.154691:0:5822:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789438291.154694:0:5822:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789438290 00002000:00010000:3.0:1789438291.154696:0:5822:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789438290 00002000:00010000:3.0:1789438291.154731:0:5822:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789438290 00010000:00010000:3.0:1789438291.154739:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b1fa71db/0x7a8dd0fcbb925a7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa49f expref: 9 pid: 11995 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.154754:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b1fa71db/0x7a8dd0fcbb925a7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa49f expref: 9 pid: 11995 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.154778:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1fa71db/0x7a8dd0fcbb925a7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa49f expref: 9 pid: 11995 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.154793:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789438291.154797:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789438291.154802:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008accc994/0x7a8dd0fcbb925abe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.154811:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008accc994/0x7a8dd0fcbb925abe lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.154852:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789438291.154900:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d055c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+8:2355:x1876361749812096:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 245us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438291.154907:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 74 00010000:00010000:0.0:1789438291.155093:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008accc994/0x7a8dd0fcbb925abe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.155103:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008accc994/0x7a8dd0fcbb925abe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.155139:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008accc994/0x7a8dd0fcbb925abe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.155154:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008accc994/0x7a8dd0fcbb925abe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.155162:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008accc994/0x7a8dd0fcbb925abe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.155169:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0000 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:0.0:1789438291.155173:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008accc994/0x7a8dd0fcbb925abe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.155181:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008accc994/0x7a8dd0fcbb925abe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.155192:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008accc994/0x7a8dd0fcbb925abe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.155199:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008accc994/0x7a8dd0fcbb925abe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438291.155241:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f46e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+7:2356:x1876361749811840:12345-192.168.206.9@tcp:1:lfs.0 Request processed in 22824us (23389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438291.155248:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 61 00000100:00100000:2.0:1789438291.160633:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438291.165307:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749812352 00000100:00100000:0.0:1789438291.165330:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749812352 00000100:00100000:0.0:1789438291.165469:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 56 00000100:00100000:0.0:1789438291.165496:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d21b8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+43:11587:x1876361749812352:12345-192.168.206.9@tcp:35:lfs.0 00000004:00010000:0.0:1789438291.165570:0:5842:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925ab0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4b4 expref: 43 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789438291.165850:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1789438291.165893:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1789438291.166527:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1789438291.166586:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925ac5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.166604:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925a6a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa491 expref: 47 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.166612:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925ac5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.166649:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925a6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa491 expref: 47 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.166664:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925a6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa491 expref: 47 pid: 7624 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438291.166680:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff938700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5842:1876361769724928:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789438291.166915:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fabaaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789438291.169530:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff938700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5842:1876361769724928:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789438291.169575:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925ac5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438291.174470:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438291.177222:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749812480 00000100:00100000:3.0:1789438291.177241:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749812480 00010000:00010000:3.0:1789438291.177294:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925a6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa491 expref: 48 pid: 7624 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438291.177396:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 75 00000100:00100000:3.0:1789438291.177423:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+48:2353:x1876361749812480:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789438291.177439:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438291.177446:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925a6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa491 expref: 48 pid: 7624 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.177460:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925a6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa491 expref: 48 pid: 7624 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.177485:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925a6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa491 expref: 48 pid: 7624 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.177503:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c3ac2500) 00010000:00010000:3.0:1789438291.177509:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925ac5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.177518:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925ac5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.177525:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925ac5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.177558:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789438291.177635:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+47:2353:x1876361749812480:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 214us (3175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438291.177642:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 75 00010000:00010000:2.0:1789438291.180573:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925ac5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.180595:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925ac5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789438291.180779:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1789438291.181019:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1789438291.181153:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fabca680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1876361769725056:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789438291.181223:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438291.181258:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fa9f1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789438291.181912:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769725056 00000100:00100000:0.0:1789438291.181931:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769725056 00000100:00100000:0.0:1789438291.182012:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789438291.182022:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1876361769725056:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789438291.182151:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1876361769725056:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 131us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438291.182158:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1789438291.182567:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789438291.182611:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fabca680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1876361769725056:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789438291.183266:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1789438291.183351:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3121180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1876361769725184:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789438291.183406:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438291.183438:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fa9f1600 going to sleep for 11 seconds 00000100:00100000:2.0:1789438291.183466:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769725184 00000100:00100000:2.0:1789438291.183471:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769725184 00000100:00100000:2.0:1789438291.183507:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789438291.183515:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fabca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1876361769725184:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789438291.183681:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fabca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5842:x1876361769725184:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 165us (273us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789438291.183688:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789438291.187637:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3121180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1876361769725184:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789438291.187750:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1789438291.187813:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925ac5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.187824:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925ac5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.187831:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925ac5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.187837:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438291.187842:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925ac5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.187850:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925ac5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.187864:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c3ac2500) 00010000:00010000:2.0:1789438291.187867:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789438291.187872:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925ac5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.187877:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925ac5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789438291.188438:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789438291.188572:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1789438291.188583:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 343453874482ns, next at 344453872657ns, rc = 0 00000001:00080000:2.0:1789438291.188589:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1789438291.188626:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c3ac2500) 00010000:00010000:2.0:1789438291.188644:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789438291.188653:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925ab0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4b4 expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438291.188842:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d21b8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+50:11587:x1876361749812352:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 23348us (28218us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1789438291.188852:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 56 00000020:00080000:2.0:1789438291.188857:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789438291.192114:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438291.192471:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749812608 00000100:00100000:1.0:1789438291.192482:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749812608 00000100:00100000:1.0:1789438291.192574:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 202 00000100:00100000:1.0:1789438291.192586:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+50:11587:x1876361749812608:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438291.192613:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438291.192637:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb925acc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa4bb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.192698:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb925acc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4bb expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.192766:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb925acc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4bb expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.192785:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:1.0:1789438291.192788:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789438291.192792:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9da200, rc 0) 00000100:00100000:1.0:1789438291.192854:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+51:11587:x1876361749812608:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 271us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438291.192861:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 202 00000100:00100000:0.0:1789438291.196046:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438291.196195:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749812864 00000100:00100000:3.0:1789438291.196205:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749812864 00000100:00100000:3.0:1789438291.196302:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 57 00000100:00100000:3.0:1789438291.196313:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff93ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+51:11587:x1876361749812864:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:3.0:1789438291.196570:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff93ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+52:11587:x1876361749812864:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 258us (532us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1789438291.196578:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 57 00000100:00100000:3.0:1789438291.283846:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438291.284287:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749812992 00000100:00100000:2.0:1789438291.284541:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749812992 00000100:00100000:2.0:1789438291.284661:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 203 00000100:00100000:2.0:1789438291.284673:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f46e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+52:11597:x1876361749812992:12345-192.168.206.9@tcp:34:lfs.0 00010000:00010000:2.0:1789438291.284777:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925ad3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.284794:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925ad3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.284806:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925ad3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.284820:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925ada lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.284827:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.284833:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.284944:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925ae1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.284953:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.284958:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789438291.285009:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.285022:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925ad3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.285029:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925ad3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.285036:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925ad3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.285042:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f1c00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438291.285047:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925ad3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.285055:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925ad3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.285066:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:2.0:1789438291.285069:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438291.285073:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925ad3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.285098:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925ad3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.285113:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.285118:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925ada lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.285124:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925ada lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.285129:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0600 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438291.285132:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925ada lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.285138:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925ada lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.285145:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9991d5872b00) 00010000:00010000:2.0:1789438291.285147:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438291.285149:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925ada lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.285155:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925ada lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.285169:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.285176:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925ae1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.285188:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925ae1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.285194:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438291.285196:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925ae1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.285203:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925ae1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.285216:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:2.0:1789438291.285218:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438291.285221:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925ae1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.285226:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925ae1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438291.285316:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f46e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+52:11597:x1876361749812992:12345-192.168.206.9@tcp:34:lfs.0 Request processed in 645us (1479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438291.285325:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 203 00000100:00100000:0.0:1789438291.339815:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438291.340129:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749813248 00000100:00100000:2.0:1789438291.340140:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749813248 00000100:00100000:2.0:1789438291.340264:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 204 00000100:00100000:2.0:1789438291.340286:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+52:11600:x1876361749813248:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789438291.340307:0:7624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438291.340533:0:7624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925ae8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa4c2 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.340622:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925aef lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.340637:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925aef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.340649:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925aef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.340664:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925af6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.340670:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925af6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.340677:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925af6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.340851:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925afd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.340860:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925afd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.340868:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925afd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438291.340878:0:7624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789438291.340985:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925aef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.340993:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925aef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.341018:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925aef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.341023:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0600 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438291.341028:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925aef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.341035:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925aef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.341049:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:2.0:1789438291.341052:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438291.341057:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925aef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.341062:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925aef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.341202:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925af6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.341210:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925af6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.341216:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925af6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.341220:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f1c00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438291.341224:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925af6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.341239:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925af6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.341248:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9991d5872b00) 00010000:00010000:2.0:1789438291.341250:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438291.341253:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925af6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.341258:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925af6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.341480:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925ae8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4c2 expref: 55 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.341497:0:7624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925afd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4c2 expref: 54 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.341504:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:2.0:1789438291.341506:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789438291.341509:0:7624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f1400, rc 0) 00000100:00100000:2.0:1789438291.341656:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+54:11600:x1876361749813248:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 1381us (1849us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1789438291.341664:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 204 00000100:00100000:3.0:1789438291.347412:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438291.347542:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749813376 00000100:00100000:0.0:1789438291.347552:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749813376 00000100:00100000:0.0:1789438291.347614:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 205 00000100:00100000:0.0:1789438291.347625:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f46e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+54:11600:x1876361749813376:12345-192.168.206.9@tcp:54:lfs.0 00010000:00010000:0.0:1789438291.347693:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb925b0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.347754:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb925b0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.347767:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb925b0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.347792:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb925b0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.347799:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb925b0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.347806:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb925b0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.347812:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63600 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438291.347816:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb925b0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.347856:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb925b0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.347868:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:0.0:1789438291.347871:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789438291.347876:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb925b0b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.347882:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb925b0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438291.347966:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f46e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+54:11600:x1876361749813376:12345-192.168.206.9@tcp:54:lfs.0 Request processed in 344us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438291.347974:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 205 00000100:00100000:3.0:1789438291.351484:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438291.351642:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749813632 00000100:00100000:2.0:1789438291.351652:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749813632 00000100:00100000:2.0:1789438291.351751:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 58 00000100:00100000:2.0:1789438291.351762:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f46e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+54:11600:x1876361749813632:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:2.0:1789438291.352047:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f46e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+55:11600:x1876361749813632:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 286us (571us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1789438291.352054:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 58 00000100:00100000:1.0:1789438291.434664:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438291.435397:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438291.435482:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438291.435521:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438291.435625:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749814016 00000100:00100000:3.0:1789438291.435636:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749814016 00000100:00100000:3.0:1789438291.435703:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 87 00000100:00100000:3.0:1789438291.435729:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff999201d38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+7:2354:x1876361749814016:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438291.435801:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff999201d38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+7:2354:x1876361749814016:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 74us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438291.435808:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 87 00000100:00100000:0.0:1789438291.441553:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749813760 00000100:00100000:0.0:1789438291.441568:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749813760 00000100:00100000:0.0:1789438291.441636:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 291 00000100:00100000:0.0:1789438291.441646:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+13:2354:x1876361749813760:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789438291.441761:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+13:2354:x1876361749813760:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 115us (6366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438291.441769:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 291 00000100:00100000:1.0:1789438291.442300:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438291.442340:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438291.442389:0:11995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749814144 00000100:00100000:3.0:1789438291.442395:0:11995:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749814144 00000100:00100000:3.0:1789438291.442436:0:11995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 88 00000100:00100000:3.0:1789438291.442445:0:11995:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff999201d39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1274be99-2d57-4dac-a13e-a89426512ee0+9:2353:x1876361749814144:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438291.442482:0:11995:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff999201d39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1274be99-2d57-4dac-a13e-a89426512ee0+9:2353:x1876361749814144:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 39us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438291.442489:0:11995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 88 00000100:00100000:0.0:1789438291.448619:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749814272 00000100:00100000:0.0:1789438291.448636:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749814272 00000100:00080000:0.0:1789438291.448682:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789438291.448782:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749814528 00000100:00100000:0.0:1789438291.448787:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749814528 00000100:00100000:0.0:1789438291.448815:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 150 00000100:00100000:0.0:1789438291.448824:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff999201d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2354:x1876361749814272:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789438291.450701:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749813888 00000100:00100000:2.0:1789438291.450727:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749813888 00000100:00100000:2.0:1789438291.450849:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 206 00000100:00100000:2.0:1789438291.451076:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff999201d3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+56:11610:x1876361749814528:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:2.0:1789438291.451100:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438291.451104:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789438291.451134:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb925a8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4a6 expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.451156:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:2.0:1789438291.451161:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789438291.451189:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925b12 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa4c9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.451288:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925b19 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.451302:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925afd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4c2 expref: 56 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.451311:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925b19 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.451347:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925afd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4c2 expref: 56 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.451381:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925afd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4c2 expref: 56 pid: 7624 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438291.451396:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876361769725312:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789438291.451484:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fa9f1480 going to sleep for 11 seconds 00000100:00100000:2.0:1789438291.451541:0:5838:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789438291.451548:0:5838:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1789438291.452571:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff999201d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2354:x1876361749814272:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 101us (13403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438291.452587:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 150 00000100:00100000:0.0:1789438291.452615:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 151 00000100:00100000:0.0:1789438291.452626:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff999201d38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+56:2353:x1876361749813888:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789438291.452679:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff999201d38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+56:2353:x1876361749813888:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 57us (18026us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438291.452685:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 151 00000100:00100000:0.0:1789438291.460730:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438291.460815:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749814656 00000100:00100000:1.0:1789438291.460825:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749814656 00010000:00010000:1.0:1789438291.460866:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925afd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4c2 expref: 56 pid: 7624 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438291.460904:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 76 00000100:00100000:1.0:1789438291.460915:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff939880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+56:2353:x1876361749814656:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789438291.460930:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438291.460937:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925afd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4c2 expref: 56 pid: 7624 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.460968:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925afd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4c2 expref: 56 pid: 7624 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.460990:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:1.0:1789438291.461004:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925b19 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.461014:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925b19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.461022:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925b19 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.461043:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438291.461146:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff939880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+56:2353:x1876361749814656:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 232us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438291.461153:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 76 00010000:00010000:2.0:1789438291.462021:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925afd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4c2 expref: 55 pid: 7624 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438291.462166:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876361769725312:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789438291.462192:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925b19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.462202:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925b19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.462208:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925b19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438291.462228:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789438291.462588:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925b12 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4c9 expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.462604:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925b19 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4c9 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.462629:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:2.0:1789438291.462632:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789438291.462635:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f1c00, rc 0) 00000100:00100000:2.0:1789438291.462676:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff999201d3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+55:11610:x1876361749814528:12345-192.168.206.9@tcp:101:bash.0 Request processed in 11818us (20334us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1789438291.462684:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 206 00000100:00100000:1.0:1789438291.466016:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438291.466453:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749814912 00000100:00100000:0.0:1789438291.466465:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749814912 00000100:00100000:0.0:1789438291.466531:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 207 00000100:00100000:0.0:1789438291.466543:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f41cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+55:11610:x1876361749814912:12345-192.168.206.9@tcp:36:bash.0 00010000:00010000:0.0:1789438291.466872:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925b27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.466889:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925b27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.466901:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925b27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789438291.467044:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1789438291.467070:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fbdda37c reply state 000000007799192a transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925b27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438291.467079:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789438291.467347:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f41cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+58:11610:x1876361749814912:12345-192.168.206.9@tcp:36:bash.0 Request processed in 805us (1336us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1789438291.467355:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 207 00000020:00080000:0.0:1789438291.467359:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789438291.468914:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925b27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.468929:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925b27 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.468938:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925b27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.468944:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438291.468948:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925b27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.468956:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925b27 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.468971:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:2.0:1789438291.468974:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438291.468979:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925b27 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.468985:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925b27 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438291.470287:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438291.470700:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749815040 00000100:00100000:2.0:1789438291.470741:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749815040 00000100:00100000:2.0:1789438291.470793:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 208 00000100:00100000:2.0:1789438291.470804:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c7db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+57:11610:x1876361749815040:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:2.0:1789438291.470829:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438291.470847:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925b2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa4d0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.470922:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb925b35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.470935:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925b19 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4c9 expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.470945:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb925b35 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.470977:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925b19 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4c9 expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.470990:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925b19 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4c9 expref: 58 pid: 5840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438291.471013:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876361769725440:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789438291.471526:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fa9f1300 going to sleep for 11 seconds 00000100:00100000:0.0:1789438291.475528:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438291.475626:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749815168 00000100:00100000:1.0:1789438291.475636:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749815168 00010000:00010000:1.0:1789438291.475815:0:8438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925b19 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4c9 expref: 59 pid: 5840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438291.475923:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 77 00000100:00100000:1.0:1789438291.476013:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff938e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1274be99-2d57-4dac-a13e-a89426512ee0+59:2353:x1876361749815168:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789438291.476030:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438291.476112:0:8438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925b19 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4c9 expref: 59 pid: 5840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.476197:0:8438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925b19 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4c9 expref: 59 pid: 5840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.476222:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:1.0:1789438291.476227:0:8438:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb925b35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.476237:0:8438:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb925b35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.476245:0:8438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb925b35 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.476265:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438291.476369:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff938e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1274be99-2d57-4dac-a13e-a89426512ee0+59:2353:x1876361749815168:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 369us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438291.476377:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 77 00010000:00010000:2.0:1789438291.476464:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925b19 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4c9 expref: 58 pid: 5840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438291.476495:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876361769725440:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789438291.476518:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb925b35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.476527:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb925b35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.476532:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb925b35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438291.476574:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789438291.476578:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789438291.476598:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb925b35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.476627:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925b2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4d0 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.476641:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb925b35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4d0 expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.476648:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:2.0:1789438291.476662:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789438291.476665:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f1000, rc 0) 00000100:00100000:2.0:1789438291.476694:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c7db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+57:11610:x1876361749815040:12345-192.168.206.9@tcp:101:bash.0 Request processed in 5893us (6418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438291.476700:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 208 00000100:00100000:0.0:1789438291.481293:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438291.481382:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749815424 00000100:00100000:2.0:1789438291.481394:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749815424 00000100:00100000:2.0:1789438291.481451:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 59 00000100:00100000:2.0:1789438291.481462:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff93b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+57:11610:x1876361749815424:12345-192.168.206.9@tcp:35:bash.0 00000100:00100000:2.0:1789438291.481855:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff93b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+58:11610:x1876361749815424:12345-192.168.206.9@tcp:35:bash.0 Request processed in 393us (570us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1789438291.481863:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 59 00000100:00100000:3.0:1789438291.545806:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438291.545940:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749815552 00000100:00100000:2.0:1789438291.545950:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749815552 00000100:00100000:2.0:1789438291.546029:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 209 00000100:00100000:2.0:1789438291.546050:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f46e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+58:11616:x1876361749815552:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789438291.546078:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438291.546102:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925b3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa4d7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.546178:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925b43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.546194:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.546205:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438291.546238:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789438291.546242:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789438291.546260:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.546284:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0600/0x7a8dd0fcbb925b3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4d7 expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.546320:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925b43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4d7 expref: 59 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.546328:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:2.0:1789438291.546331:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789438291.546335:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f1c00, rc 0) 00000100:00100000:2.0:1789438291.546399:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f46e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+59:11616:x1876361749815552:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 352us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438291.546406:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 209 00000100:00100000:0.0:1789438291.549921:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438291.550069:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749815680 00000100:00100000:2.0:1789438291.550081:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749815680 00000100:00100000:2.0:1789438291.550149:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 210 00000100:00100000:2.0:1789438291.550161:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff93b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+59:11616:x1876361749815680:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789438291.550181:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438291.550201:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925b4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa4de expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.550268:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925b51 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.550284:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925b51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.550297:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925b51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.550313:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb925b58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.550338:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb925b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.550345:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb925b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.550438:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925b5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.550447:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.550453:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438291.550489:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789438291.550493:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789438291.550510:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.550521:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.550529:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925b51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.550534:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925b51 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.550541:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925b51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.550557:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f1400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438291.550561:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925b51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.550568:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925b51 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.550580:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:2.0:1789438291.550582:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438291.550587:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925b51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.550592:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1400/0x7a8dd0fcbb925b51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.550622:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb925b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.550628:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb925b58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.550633:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb925b58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.550638:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0a00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438291.550641:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb925b58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.550646:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb925b58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.550665:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9991d5872b00) 00010000:00010000:2.0:1789438291.550668:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438291.550671:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb925b58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.550678:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0a00/0x7a8dd0fcbb925b58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.556606:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0800/0x7a8dd0fcbb925b4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4de expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.556647:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925b5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4de expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.556657:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:2.0:1789438291.556660:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789438291.556664:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e74f1800, rc 0) 00000100:00100000:2.0:1789438291.556810:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff93b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+60:11616:x1876361749815680:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 6650us (6897us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438291.556821:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 210 00000100:00100000:0.0:1789438291.560353:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438291.560398:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438291.560469:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749815936 00000100:00100000:2.0:1789438291.560480:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749815936 00000100:00100000:2.0:1789438291.560540:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 211 00000100:00100000:2.0:1789438291.560551:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+60:11616:x1876361749815936:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789438291.560572:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438291.560593:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925b66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa4e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.560772:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1200/0x7a8dd0fcbb925b6d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.560787:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb925b35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4d0 expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.560796:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925b5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4de expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.560804:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1200/0x7a8dd0fcbb925b6d lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.560839:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925b5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4de expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.560854:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925b5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4de expref: 61 pid: 5839 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438291.560869:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876361769725568:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789438291.561083:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb925b35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4d0 expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.561093:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb925b35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4d0 expref: 61 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438291.561103:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876361769725696:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789438291.561147:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fa9f1300 going to sleep for 11 seconds 00000100:00100000:1.0:1789438291.561362:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749816064 00000100:00100000:1.0:1789438291.561369:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749816064 00010000:00010000:1.0:1789438291.561394:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925b5f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4de expref: 62 pid: 5839 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438291.561429:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 78 00000100:00100000:1.0:1789438291.561437:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff939500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+62:2354:x1876361749816064:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789438291.561447:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438291.561455:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925b5f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4de expref: 62 pid: 5839 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.561474:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925b5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4de expref: 62 pid: 5839 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.561493:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:1.0:1789438291.561498:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1200/0x7a8dd0fcbb925b6d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.561505:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1200/0x7a8dd0fcbb925b6d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.561512:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438291.561549:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff939500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+62:2354:x1876361749816064:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 112us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438291.561556:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 78 00010000:00010000:0.0:1789438291.562981:0:5838:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.9@tcp) returned -22 from blocking AST (req@00000000b3c68e9c x1876361769725568) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925b5f lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4de expref: 61 pid: 5839 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.563015:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1800/0x7a8dd0fcbb925b5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4de expref: 61 pid: 5839 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438291.563034:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876361769725568:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789438291.564039:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876361769725696:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438291.564068:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:0.0:1789438291.564074:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1200/0x7a8dd0fcbb925b6d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.564084:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1200/0x7a8dd0fcbb925b6d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.564094:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1200/0x7a8dd0fcbb925b6d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438291.568481:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438291.568591:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749816192 00000100:00100000:3.0:1789438291.568601:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749816192 00010000:00010000:3.0:1789438291.568646:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb925b35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4d0 expref: 61 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438291.568705:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 79 00000100:00100000:3.0:1789438291.568750:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa647800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+61:2354:x1876361749816192:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789438291.568766:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438291.568775:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb925b35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4d0 expref: 61 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.568789:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb925b35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4d0 expref: 61 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.568810:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1000/0x7a8dd0fcbb925b35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4d0 expref: 61 pid: 5838 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.568825:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:3.0:1789438291.568830:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1200/0x7a8dd0fcbb925b6d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.568838:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1200/0x7a8dd0fcbb925b6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.568845:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1200/0x7a8dd0fcbb925b6d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.568874:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789438291.568925:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa647800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+60:2354:x1876361749816192:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 186us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438291.568932:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 79 00010000:00010000:3.0:1789438291.568961:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1200/0x7a8dd0fcbb925b6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.568975:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1200/0x7a8dd0fcbb925b6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789438291.569006:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789438291.569155:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0000/0x7a8dd0fcbb925b66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4e5 expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.569169:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1200/0x7a8dd0fcbb925b6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4e5 expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.569176:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:3.0:1789438291.569178:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789438291.569181:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c69e1200, rc 0) 00000100:00100000:3.0:1789438291.569203:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+60:11616:x1876361749815936:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 8655us (8862us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1789438291.569209:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 211 00000100:00100000:2.0:1789438291.575985:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438291.576093:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749816448 00000100:00100000:1.0:1789438291.576114:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749816448 00000100:00100000:1.0:1789438291.576186:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:1.0:1789438291.576198:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+60:11616:x1876361749816448:12345-192.168.206.9@tcp:103:lfs.0 00010000:00010000:1.0:1789438291.576220:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438291.576246:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb925acc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4bb expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.576267:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:1.0:1789438291.576273:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438291.576391:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+59:11616:x1876361749816448:12345-192.168.206.9@tcp:103:lfs.0 Request processed in 194us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438291.576424:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:2.0:1789438291.593338:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438291.593559:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749816576 00000100:00100000:0.0:1789438291.593582:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749816576 00000100:00100000:0.0:1789438291.593679:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 212 00000100:00100000:0.0:1789438291.593690:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+59:11616:x1876361749816576:12345-192.168.206.9@tcp:58:lfs.0 00010000:00010000:0.0:1789438291.593843:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925b7b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.593861:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925b7b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.593873:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925b7b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789438291.594078:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1789438291.594166:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+59:11616:x1876361749816576:12345-192.168.206.9@tcp:58:lfs.0 Request processed in 478us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438291.594175:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 212 00000100:00100000:3.0:1789438291.596665:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438291.603736:0:12507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749816704 00000100:00100000:2.0:1789438291.603754:0:12507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749816704 00000100:00100000:1.0:1789438291.603862:0:12507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 213 00000100:00100000:1.0:1789438291.603874:0:12507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f46e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1274be99-2d57-4dac-a13e-a89426512ee0+59:11616:x1876361749816704:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438291.603898:0:12507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438291.603921:0:12507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb925b82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa4ec expref: -99 pid: 12507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.604271:0:12507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925b7b lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.604283:0:12507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb925b82 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4ec expref: 60 pid: 12507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.604303:0:12507:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925b7b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.604318:0:12507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb925b82 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4ec expref: 60 pid: 12507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.604331:0:12507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:1.0:1789438291.604335:0:12507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789438291.604339:0:12507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb925b82 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4ec expref: 60 pid: 12507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.604346:0:12507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9da200, rc 0) 00000100:00100000:1.0:1789438291.605237:0:12507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f46e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1274be99-2d57-4dac-a13e-a89426512ee0+60:11616:x1876361749816704:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 1354us (8570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438291.605261:0:12507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 213 00000040:00080000:2.0:1789438291.639004:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789438291.639015:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789438291.639232:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1789438291.639240:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789438291.639365:0:11668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11668:1876361769725824:192.168.206.9@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789438291.639459:0:11668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fa9f1180 going to sleep for 11 seconds 00000100:00100000:3.0:1789438291.642883:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438291.643052:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749816832 00000100:00100000:0.0:1789438291.643063:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749816832 00000100:00100000:0.0:1789438291.643128:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 214 00000100:00100000:0.0:1789438291.643139:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c31f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+61:11617:x1876361749816832:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789438291.643170:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789438291.643279:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c31f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+61:11617:x1876361749816832:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 Request processed in 141us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438291.643287:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 214 00000100:00100000:2.0:1789438291.644642:0:11668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11668:1876361769725824:192.168.206.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789438291.645315:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438291.645381:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749816960 00000100:00100000:2.0:1789438291.645388:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749816960 00000100:00100000:2.0:1789438291.645443:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 215 00000100:00100000:2.0:1789438291.645453:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f438c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+60:11617:x1876361749816960:12345-192.168.206.9@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789438291.645517:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0400/0x7a8dd0fcbb925b89 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.645535:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0400/0x7a8dd0fcbb925b89 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.645547:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0400/0x7a8dd0fcbb925b89 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.645563:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb925b90 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.645570:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb925b90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.645591:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb925b90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.645614:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0a00/0x7a8dd0fcbb925b97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.645623:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0a00/0x7a8dd0fcbb925b97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.645629:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0a00/0x7a8dd0fcbb925b97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438291.645675:0:7624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789438291.645679:0:7624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789438291.645692:0:7624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0a00/0x7a8dd0fcbb925b97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.645703:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0400/0x7a8dd0fcbb925b89 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.645730:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0400/0x7a8dd0fcbb925b89 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.645737:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0400/0x7a8dd0fcbb925b89 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.645742:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c69e0400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438291.645747:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0400/0x7a8dd0fcbb925b89 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.645755:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0400/0x7a8dd0fcbb925b89 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.645773:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9991d5872000) 00010000:00010000:2.0:1789438291.645776:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438291.645781:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0400/0x7a8dd0fcbb925b89 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.645787:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0400/0x7a8dd0fcbb925b89 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.645801:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb925b90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.645806:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb925b90 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.645811:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb925b90 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.645816:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c69e0800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438291.645818:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb925b90 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.645824:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb925b90 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.645830:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9991d5872b00) 00010000:00010000:2.0:1789438291.645832:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438291.645835:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb925b90 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.645839:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb925b90 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.645862:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0a00/0x7a8dd0fcbb925b97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.645868:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0a00/0x7a8dd0fcbb925b97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.645873:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0a00/0x7a8dd0fcbb925b97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.645878:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c69e0a00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438291.645881:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0a00/0x7a8dd0fcbb925b97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.645887:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0a00/0x7a8dd0fcbb925b97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.645894:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:2.0:1789438291.645897:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438291.645900:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0a00/0x7a8dd0fcbb925b97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.645905:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0a00/0x7a8dd0fcbb925b97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438291.645978:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f438c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+60:11617:x1876361749816960:12345-192.168.206.9@tcp:34:lhsmtool_posix.0 Request processed in 524us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438291.645986:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 215 00000100:00100000:3.0:1789438291.649683:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438291.649949:0:12507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749817216 00000100:00100000:1.0:1789438291.649962:0:12507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749817216 00000100:00100000:1.0:1789438291.650176:0:12507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 216 00000100:00100000:1.0:1789438291.650191:0:12507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1274be99-2d57-4dac-a13e-a89426512ee0+60:11617:x1876361749817216:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789438291.650215:0:12507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438291.650237:0:12507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925b9e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa4f3 expref: -99 pid: 12507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.650337:0:12507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925ba5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.650353:0:12507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.650365:0:12507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438291.650377:0:12507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789438291.650475:0:12507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.650483:0:12507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925ba5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.650491:0:12507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.650497:0:12507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dba00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438291.650501:0:12507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.650523:0:12507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925ba5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.650536:0:12507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:1.0:1789438291.650539:0:12507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789438291.650545:0:12507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925ba5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.650552:0:12507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925ba5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.650595:0:12507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925b9e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4f3 expref: 62 pid: 12507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.650604:0:12507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9991d5872000) 00010000:00010000:1.0:1789438291.650606:0:12507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789438291.650610:0:12507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925b9e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4f3 expref: 62 pid: 12507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.650619:0:12507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9dbe00, rc 0) 00000100:00100000:1.0:1789438291.650682:0:12507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1274be99-2d57-4dac-a13e-a89426512ee0+61:11617:x1876361749817216:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 495us (1007us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1789438291.653212:0:12507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 216 00000100:00100000:3.0:1789438291.654207:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438291.656601:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749817344 00000100:00100000:1.0:1789438291.656617:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749817344 00000100:00100000:1.0:1789438291.656698:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 217 00000100:00100000:1.0:1789438291.656731:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+61:11617:x1876361749817344:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789438291.656790:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789438291.656903:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+61:11617:x1876361749817344:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 Request processed in 196us (2701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438291.656911:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 217 00000100:00100000:3.0:1789438291.667249:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438291.667567:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749817600 00000100:00100000:0.0:1789438291.667579:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749817600 00000100:00100000:0.0:1789438291.667643:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 218 00000100:00100000:0.0:1789438291.667666:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+61:11617:x1876361749817600:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789438291.667701:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438291.667704:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789438291.667771:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1c00/0x7a8dd0fcbb925b43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4d7 expref: 61 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.667791:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:0.0:1789438291.667796:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789438291.667809:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925bb3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa4fa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789438291.668295:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1789438291.668490:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925bba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.668505:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925bba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.668516:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925bba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.668567:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925bb3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4fa expref: 63 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.668584:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925bba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4fa expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.668592:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9991c3ac2300) 00010000:00010000:0.0:1789438291.668595:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789438291.668603:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63800, rc 0) 00000100:00100000:0.0:1789438291.668665:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+62:11617:x1876361749817600:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 999us (1425us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1789438291.668673:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 218 00000100:00100000:3.0:1789438291.680032:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438291.680109:0:12507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749817856 00000100:00100000:1.0:1789438291.680120:0:12507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749817856 00000100:00100000:1.0:1789438291.680186:0:12507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 219 00000100:00100000:1.0:1789438291.680197:0:12507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1274be99-2d57-4dac-a13e-a89426512ee0+62:11617:x1876361749817856:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789438291.680254:0:12507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438291.680284:0:12507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63800/0x7a8dd0fcbb925bba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4fa expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.680304:0:12507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9991c3ac2300) 00010000:00010000:1.0:1789438291.680315:0:12507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789438291.680335:0:12507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925bc8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.680349:0:12507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925bc8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.680358:0:12507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925bc8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.680371:0:12507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925bcf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x3c60709e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.680378:0:12507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925bcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3c60709e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.680400:0:12507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925bcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3c60709e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.680465:0:12507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925bc8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.680472:0:12507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925bc8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.680478:0:12507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925bc8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.680484:0:12507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dbe00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438291.680488:0:12507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925bc8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.680495:0:12507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925bc8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.680504:0:12507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:1.0:1789438291.680506:0:12507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438291.680510:0:12507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925bc8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.680516:0:12507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dbe00/0x7a8dd0fcbb925bc8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.680525:0:12507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925bcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3c60709e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.680531:0:12507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925bcf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3c60709e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.680543:0:12507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925bcf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3c60709e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.680548:0:12507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dba00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438291.680551:0:12507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925bcf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3c60709e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.680558:0:12507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925bcf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3c60709e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.680565:0:12507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x3c60709e (ffff9991c7c83600) 00010000:00010000:1.0:1789438291.680568:0:12507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438291.680571:0:12507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925bcf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3c60709e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.680576:0:12507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dba00/0x7a8dd0fcbb925bcf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3c60709e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438291.680654:0:12507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1274be99-2d57-4dac-a13e-a89426512ee0+61:11617:x1876361749817856:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 458us (630us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789438291.680662:0:12507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 219 00000100:00100000:3.0:1789438291.690489:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438291.690612:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749817984 00000100:00100000:0.0:1789438291.690623:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749817984 00000100:00100000:0.0:1789438291.690684:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 220 00000100:00100000:0.0:1789438291.690695:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+61:11617:x1876361749817984:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789438291.690755:0:7624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438291.690779:0:7624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925bd6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa501 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.690815:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925bdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.690829:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925bdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.690841:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925bdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.690953:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925bd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa501 expref: 63 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.690972:0:7624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925bdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa501 expref: 62 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.690981:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9991c3ac2c00) 00010000:00010000:0.0:1789438291.690984:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789438291.691007:0:7624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63a00, rc 0) 00000100:00100000:0.0:1789438291.691075:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+62:11617:x1876361749817984:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 382us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438291.691083:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 220 00000100:00100000:3.0:1789438291.693773:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438291.694481:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749818240 00000100:00100000:0.0:1789438291.694494:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749818240 00000100:00100000:0.0:1789438291.694605:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 221 00000100:00100000:0.0:1789438291.694617:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+62:11617:x1876361749818240:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789438291.694702:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925be4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.694759:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925be4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.694772:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925be4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789438291.695031:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:0.0:1789438291.695114:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b19507b9 reply state 0000000054a608ca transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925be4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438291.695136:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789438291.695228:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+64:11617:x1876361749818240:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 612us (1461us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1789438291.695236:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 221 00010000:00010000:1.0:1789438291.697549:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925be4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.697580:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925be4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.697595:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925be4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.697621:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63c00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438291.697626:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925be4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.697772:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925be4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.697790:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9991c3ac2c00) 00010000:00010000:1.0:1789438291.697793:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789438291.697799:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925be4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.697805:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925be4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438291.698147:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438291.700403:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749818368 00000100:00100000:2.0:1789438291.700418:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749818368 00000100:00100000:2.0:1789438291.700488:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 222 00000100:00100000:2.0:1789438291.700514:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+63:11617:x1876361749818368:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789438291.700539:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438291.700559:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb925beb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa508 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.700621:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb925beb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa508 expref: 64 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.700637:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb925beb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa508 expref: 64 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.700657:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9991c3ac2c00) 00010000:00010000:2.0:1789438291.700661:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789438291.700665:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c69e0800, rc 0) 00000100:00100000:2.0:1789438291.700744:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+64:11617:x1876361749818368:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 232us (2600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438291.700752:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 222 00000100:00100000:2.0:1789438291.703693:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438291.703834:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749818496 00000100:00100000:0.0:1789438291.703845:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749818496 00000100:00100000:0.0:1789438291.703901:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 62 00000100:00100000:0.0:1789438291.703912:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+9:2353:x1876361749818496:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789438291.704361:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+10:2353:x1876361749818496:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 Request processed in 450us (676us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1789438291.704369:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 62 00000100:00100000:3.0:1789438291.707297:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438291.707474:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749818752 00000100:00100000:2.0:1789438291.707486:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749818752 00000100:00100000:2.0:1789438291.707552:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 60 00000100:00100000:2.0:1789438291.707563:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+64:11617:x1876361749818752:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789438291.707816:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+65:11617:x1876361749818752:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 Request processed in 254us (527us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1789438291.707823:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 60 00000100:00100000:2.0:1789438291.711028:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438291.711340:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749819008 00000100:00100000:3.0:1789438291.711351:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749819008 00000100:00100000:3.0:1789438291.711411:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 223 00000100:00100000:3.0:1789438291.711421:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+65:11617:x1876361749819008:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789438291.711533:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+65:11617:x1876361749819008:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 113us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438291.711540:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 223 00000100:00100000:3.0:1789438291.713956:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438291.714073:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749819136 00000100:00100000:0.0:1789438291.714084:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749819136 00000100:00100000:0.0:1789438291.714147:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 224 00000100:00100000:0.0:1789438291.714156:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+65:11617:x1876361749819136:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789438291.714280:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438291.714304:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925bf2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa50f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.714394:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925bf9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.714407:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.714418:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438291.714451:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789438291.714468:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.714500:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925bf2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa50f expref: 67 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.714517:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925bf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa50f expref: 66 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.714536:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9991c3ac2c00) 00010000:00010000:0.0:1789438291.714539:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789438291.714542:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63c00, rc 0) 00000100:00100000:0.0:1789438291.714606:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+66:11617:x1876361749819136:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 450us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438291.714614:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 224 00000100:00100000:0.0:1789438291.721178:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438291.721338:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749819264 00000100:00100000:2.0:1789438291.721349:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749819264 00000100:00100000:2.0:1789438291.721407:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 63 00000100:00100000:2.0:1789438291.721418:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff93a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1274be99-2d57-4dac-a13e-a89426512ee0+10:2354:x1876361749819264:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789438291.721436:0:8192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438291.721458:0:8192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4de65e2/0x7a8dd0fcbb925c00 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa516 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789438291.721485:0:8192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa8a953, blocks: 0x1 00010000:00010000:2.0:1789438291.721527:0:8192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=343s v=(0 0) 00010000:00010000:2.0:1789438291.721531:0:8192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789438291.721541:0:8192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4de65e2/0x7a8dd0fcbb925c00 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa516 expref: 11 pid: 8192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.721559:0:8192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e4de65e2/0x7a8dd0fcbb925c00 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa516 expref: 11 pid: 8192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.721572:0:8192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c69e0e00, rc 0) 00000100:00100000:2.0:1789438291.721639:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff93a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1274be99-2d57-4dac-a13e-a89426512ee0+11:2354:x1876361749819264:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 222us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438291.721647:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 63 00000100:00100000:3.0:1789438291.724515:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438291.724636:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749819520 00000100:00100000:0.0:1789438291.724645:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749819520 00000100:00100000:0.0:1789438291.724699:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 225 00000100:00100000:0.0:1789438291.724739:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+66:11617:x1876361749819520:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789438291.724837:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+66:11617:x1876361749819520:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 130us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438291.724844:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 225 00000100:00100000:0.0:1789438291.732100:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438291.732207:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749819648 00000100:00100000:1.0:1789438291.732218:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749819648 00000100:00100000:1.0:1789438291.732273:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 64 00000100:00100000:1.0:1789438291.732283:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1274be99-2d57-4dac-a13e-a89426512ee0+11:11617:x1876361749819648:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789438291.732301:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438291.732319:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925c07 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa51d expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.732351:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4de65e2/0x7a8dd0fcbb925c00 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa516 expref: 12 pid: 8192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.732360:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438291.732364:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438291.732386:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925c07 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa51d expref: 12 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.732436:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e4de65e2/0x7a8dd0fcbb925c00 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa516 expref: 12 pid: 8192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.732451:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e4de65e2/0x7a8dd0fcbb925c00 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa516 expref: 12 pid: 8192 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438291.732466:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876361769725952:192.168.206.9@tcp:104: 00000100:00100000:1.0:1789438291.732562:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f47de9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789438291.737662:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876361769725952:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789438291.737751:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925c07 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa51d expref: 12 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.737778:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9dbe00, rc 0) 00000100:00100000:2.0:1789438291.737847:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1274be99-2d57-4dac-a13e-a89426512ee0+12:11617:x1876361749819648:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 5564us (5756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438291.737855:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 64 00000100:00100000:3.0:1789438291.739803:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438291.740138:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749819776 00000100:00100000:0.0:1789438291.740148:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749819776 00010000:00010000:0.0:1789438291.740296:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e4de65e2/0x7a8dd0fcbb925c00 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa516 expref: 12 pid: 8192 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438291.740339:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 80 00000100:00100000:0.0:1789438291.740349:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d055f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+12:2354:x1876361749819776:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789438291.740363:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438291.740386:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000e4de65e2/0x7a8dd0fcbb925c00 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa516 expref: 12 pid: 8192 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.740413:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e4de65e2/0x7a8dd0fcbb925c00 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa516 expref: 12 pid: 8192 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.740436:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4de65e2/0x7a8dd0fcbb925c00 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa516 expref: 12 pid: 8192 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.740453:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789438291.740457:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789438291.740464:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925c07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa51d expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.740474:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925c07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa51d expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.740513:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925c07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa51d expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438291.740527:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff939180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5823:1876361769726080:192.168.206.9@tcp:105: 00000100:00100000:0.0:1789438291.740618:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fabaac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789438291.754016:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438291.754160:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff939180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5823:1876361769726080:192.168.206.9@tcp:105: 00010000:00010000:3.0:1789438291.754196:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789438291.754256:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d055f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1274be99-2d57-4dac-a13e-a89426512ee0+11:2354:x1876361749819776:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 13907us (14461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438291.754268:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 80 00000100:00100000:2.0:1789438291.754802:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749819904 00000100:00100000:2.0:1789438291.754810:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749819904 00002000:00100000:2.0:1789438291.754850:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9991ff938700 x1876361749819904/t0(0) o4->1274be99-2d57-4dac-a13e-a89426512ee0@192.168.206.9@tcp:722/0 lens 504/0 e 0 to 0 dl 1789438302 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789438291.754860:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9991ff938700 with x1876361749819904 ext(0->12) 00002000:00010000:2.0:1789438291.754865:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9991ff938700 00000100:00100000:2.0:1789438291.754895:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 6 00000100:00100000:2.0:1789438291.754903:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1274be99-2d57-4dac-a13e-a89426512ee0+11:2353:x1876361749819904:12345-192.168.206.9@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789438291.755373:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1274be99-2d57-4dac-a13e-a89426512ee0+13:2353:x1876361749819904:12345-192.168.206.9@tcp:4:lhsmtool_posix.0 Request processed in 469us (1374us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1789438291.755381:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 6 00002000:00100000:2.0:1789438291.755388:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9991ff938700 x1876361749819904/t4294967320(0) o4->1274be99-2d57-4dac-a13e-a89426512ee0@192.168.206.9@tcp:722/0 lens 504/448 e 0 to 0 dl 1789438302 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789438291.755397:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9991ff938700 with x1876361749819904 ext(0->12) 00002000:00010000:2.0:1789438291.755400:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9991ff938700 00000100:00100000:0.0:1789438291.759069:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438291.759163:0:12507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749820032 00000100:00100000:1.0:1789438291.759172:0:12507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749820032 00000100:00100000:1.0:1789438291.759228:0:12507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 226 00000100:00100000:1.0:1789438291.759240:0:12507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1274be99-2d57-4dac-a13e-a89426512ee0+66:11617:x1876361749820032:12345-192.168.206.9@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1789438291.827781:0:12507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1274be99-2d57-4dac-a13e-a89426512ee0+66:11617:x1876361749820032:12345-192.168.206.9@tcp:44:lhsmtool_posix.0 Request processed in 68534us (68713us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438291.827794:0:12507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 226 00000001:00080000:2.0:1789438291.827844:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:2.0:1789438291.827867:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:2.0:1789438291.827893:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9990c1385180 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1789438291.827896:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9991d1ae9b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9990c13859c0 00000020:00080000:2.0:1789438291.827911:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9991d1ae9900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff999201d89c00 00000001:00080000:2.0:1789438291.830034:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1789438291.830057:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1789438291.830076:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9991fa9f1f00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1789438291.830081:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9991f118ed00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9991fa9f16c0 00000020:00080000:2.0:1789438291.830084:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9991f118e100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9991fa54fc00 00000100:00100000:0.0:1789438291.830484:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789438291.830503:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769726208:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789438291.830568:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438291.830747:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789438291.830756:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769726336:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789438291.830785:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438291.830823:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769726208 00000100:00100000:2.0:1789438291.830830:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769726208 00000100:00100000:2.0:1789438291.830868:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769726336 00000100:00100000:2.0:1789438291.830871:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769726336 00000100:00100000:2.0:1789438291.830900:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789438291.830908:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4009850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1876361769726208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789438291.831104:0:8192:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1789438291.831250:0:8192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa8a952, atime: 0x6aa8a952, ctime: 0x6aa8a952, blocks: 0x1 00010000:00010000:2.0:1789438291.831259:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000681e0f40/0x7a8dd0fcbb925c0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.831276:0:8192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=344s v=(0 0) 00010000:00010000:2.0:1789438291.831282:0:8192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789438291.831288:0:8192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000681e0f40/0x7a8dd0fcbb925c0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.831302:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000681e0f40/0x7a8dd0fcbb925c0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.831323:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000681e0f40/0x7a8dd0fcbb925c0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.831330:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000681e0f40/0x7a8dd0fcbb925c0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.831394:0:8192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789438291.831970:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4009850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1876361769726208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1059us (1398us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789438291.831980:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000020:00080000:1.0:1789438291.832267:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1789438291.832384:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789438291.832621:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789438291.832635:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1876361769726336:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789438291.832660:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:3.0:1789438291.832684:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925c15 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.832703:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000739958eb/0x7a8dd0fcbb9259d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa47c expref: 12 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.832738:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789438291.832742:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789438291.832756:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925c15 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.832790:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000739958eb/0x7a8dd0fcbb9259d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa47c expref: 12 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.832804:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000739958eb/0x7a8dd0fcbb9259d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa47c expref: 12 pid: 8192 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438291.832819:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa714e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876361769726464:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789438291.832884:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d019c240 going to sleep for 11 seconds 00000100:00100000:3.0:1789438291.832982:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438291.833155:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749820160 00000100:00100000:2.0:1789438291.833162:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749820160 00000100:00100000:2.0:1789438291.833389:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 67 00000100:00100000:2.0:1789438291.833398:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1274be99-2d57-4dac-a13e-a89426512ee0+13:2353:x1876361749820160:12345-192.168.206.9@tcp:16:lhsmtool_posix.0 00000100:00080000:2.0:1789438291.833442:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789438291.833480:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9991ff939880/2, rc 0, transno 4294967310 00000100:00100000:2.0:1789438291.833486:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769726208:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789438291.836737:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa714e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876361769726464:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789438291.836767:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925c15 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438291.838535:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438291.839069:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749820288 00000100:00100000:2.0:1789438291.839080:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749820288 00010000:00010000:2.0:1789438291.839132:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000739958eb/0x7a8dd0fcbb9259d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa47c expref: 14 pid: 8192 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438291.839175:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 81 00000100:00100000:2.0:1789438291.839186:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa714e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+14:2354:x1876361749820288:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789438291.839213:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438291.839219:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000739958eb/0x7a8dd0fcbb9259d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa47c expref: 14 pid: 8192 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.839243:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000739958eb/0x7a8dd0fcbb9259d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa47c expref: 14 pid: 8192 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.839265:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000739958eb/0x7a8dd0fcbb9259d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa47c expref: 14 pid: 8192 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.839283:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789438291.839287:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789438291.839292:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925c15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.839303:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925c15 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.839593:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789438291.839651:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa714e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+13:2354:x1876361749820288:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 465us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438291.839659:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 81 00010000:00010000:2.0:1789438291.839688:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925c15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.839698:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925c15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.839758:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925c15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.839767:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925c15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.839971:0:11648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789438291.839980:0:11648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000681e0f40/0x7a8dd0fcbb925c0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.839988:0:11648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c69e0c00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:0.0:1789438291.839992:0:11648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000681e0f40/0x7a8dd0fcbb925c0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.840011:0:11648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000681e0f40/0x7a8dd0fcbb925c0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.840025:0:11648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000681e0f40/0x7a8dd0fcbb925c0e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.840032:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000681e0f40/0x7a8dd0fcbb925c0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.841005:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789438291.841016:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925c15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.841025:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54200 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:1.0:1789438291.841029:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925c15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.841038:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925c15 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.841059:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925c15 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.841078:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438291.841080:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438291.841081:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438291.841536:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438291.841539:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438291.841541:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438291.847619:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789438291.847636:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925c15 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438291.848296:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1876361769726336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15662us (17505us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789438291.848307:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:0.0:1789438291.848956:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9991f3d2ce00/2, rc 0, transno 4294967321 00000100:00100000:0.0:1789438291.848981:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769726336:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789438291.851061:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789438291.867028:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:0.0:1789438291.867051:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:0.0:1789438291.867058:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:2.0:1789438291.867386:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1274be99-2d57-4dac-a13e-a89426512ee0+7:2353:x1876361749820160:12345-192.168.206.9@tcp:16:lhsmtool_posix.0 Request processed in 33983us (34397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438291.867398:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 67 00000100:00100000:3.0:1789438291.869651:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438291.869810:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749820544 00000100:00100000:2.0:1789438291.869820:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749820544 00000100:00100000:2.0:1789438291.870133:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 227 00000100:00100000:2.0:1789438291.870146:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+20:11617:x1876361749820544:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789438291.870195:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438291.870225:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925bf9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa50f expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.870243:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9991c3ac2c00) 00010000:00010000:2.0:1789438291.870259:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789438291.870290:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0600/0x7a8dd0fcbb925c1c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.870303:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0600/0x7a8dd0fcbb925c1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.870314:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0600/0x7a8dd0fcbb925c1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789438291.870549:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5893bdc reply state 00000000d93b88f1 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0600/0x7a8dd0fcbb925c1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438291.870559:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789438291.870667:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+21:11617:x1876361749820544:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 523us (1023us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1789438291.870674:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 227 00000100:00100000:1.0:1789438291.873938:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438291.873986:0:11995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749820672 00000100:00100000:1.0:1789438291.874004:0:11995:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749820672 00000100:00100000:1.0:1789438291.874060:0:11995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 68 00000100:00100000:1.0:1789438291.874071:0:11995:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1274be99-2d57-4dac-a13e-a89426512ee0+7:2354:x1876361749820672:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789438291.874312:0:11995:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789438291.874317:0:11995:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789438291 00002000:00010000:1.0:1789438291.874320:0:11995:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789438290 00002000:00010000:1.0:1789438291.874322:0:11995:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789438291 -> 1789438291 00002000:00010000:1.0:1789438291.874324:0:11995:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789438291.874378:0:11995:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1274be99-2d57-4dac-a13e-a89426512ee0+8:2354:x1876361749820672:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 Request processed in 309us (454us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1789438291.874386:0:11995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 68 00010000:00010000:3.0:1789438291.874553:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0600/0x7a8dd0fcbb925c1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.874564:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0600/0x7a8dd0fcbb925c1c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.874573:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0600/0x7a8dd0fcbb925c1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.874579:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c69e0600 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438291.874597:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0600/0x7a8dd0fcbb925c1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.874606:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0600/0x7a8dd0fcbb925c1c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.874623:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9991c3ac2c00) 00010000:00010000:3.0:1789438291.874626:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789438291.874631:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0600/0x7a8dd0fcbb925c1c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.874638:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0600/0x7a8dd0fcbb925c1c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438291.876910:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438291.877577:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749820928 00000100:00100000:0.0:1789438291.877589:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749820928 00000100:00100000:0.0:1789438291.877648:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 228 00000100:00100000:0.0:1789438291.877673:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+20:11617:x1876361749820928:12345-192.168.206.9@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789438291.877762:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925c23 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.877779:0:7624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925bdd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa501 expref: 20 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.877788:0:7624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925c23 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.877826:0:7624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925bdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa501 expref: 20 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.877840:0:7624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925bdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa501 expref: 20 pid: 7624 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438291.877855:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff938e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7624:1876361769726592:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789438291.878775:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c7e88840 going to sleep for 11 seconds 00000100:00100000:3.0:1789438291.879947:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff938e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7624:1876361769726592:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789438291.879978:0:7624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925c23 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438291.881624:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438291.882033:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749821056 00000100:00100000:1.0:1789438291.882043:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749821056 00010000:00010000:1.0:1789438291.882086:0:8438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925bdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa501 expref: 21 pid: 7624 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438291.882129:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 82 00000100:00100000:1.0:1789438291.882154:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa715500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1274be99-2d57-4dac-a13e-a89426512ee0+21:2354:x1876361749821056:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789438291.882172:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438291.882179:0:8438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925bdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa501 expref: 21 pid: 7624 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.882191:0:8438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925bdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa501 expref: 21 pid: 7624 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.882214:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925bdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa501 expref: 21 pid: 7624 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.882232:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9991c3ac2c00) 00010000:00010000:1.0:1789438291.882236:0:8438:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925c23 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.882247:0:8438:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925c23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.882255:0:8438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925c23 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.882288:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438291.882350:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa715500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1274be99-2d57-4dac-a13e-a89426512ee0+20:2354:x1876361749821056:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 196us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438291.882357:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 82 00010000:00010000:0.0:1789438291.882537:0:7624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925c23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.882546:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925c23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.882575:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925c23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.882581:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925c23 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.882600:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925c23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.882605:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438291.882609:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925c23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.882616:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925c23 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.882625:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9991c3ac2c00) 00010000:00010000:0.0:1789438291.882628:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789438291.882631:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925c23 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.882638:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925c23 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438291.882691:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+19:11617:x1876361749820928:12345-192.168.206.9@tcp:55:lhsmtool_posix.0 Request processed in 5021us (5791us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789438291.882699:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 228 00000100:00100000:3.0:1789438291.886235:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438291.886348:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749821184 00000100:00100000:2.0:1789438291.886359:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749821184 00000100:00100000:2.0:1789438291.886408:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 69 00000100:00100000:2.0:1789438291.886419:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa716300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1274be99-2d57-4dac-a13e-a89426512ee0+8:2356:x1876361749821184:12345-192.168.206.9@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789438291.886463:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fa7c4ee9/0x7a8dd0fcbb925c2a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.886484:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925c07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa51d expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.886493:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789438291.886497:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789438291.887167:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa7c4ee9/0x7a8dd0fcbb925c2a lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.887206:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925c07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa51d expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.887220:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925c07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa51d expref: 8 pid: 6681 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438291.887236:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876361769726720:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789438291.887318:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f44a7000 going to sleep for 11 seconds 00000100:00100000:3.0:1789438291.891386:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438291.891465:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749821312 00000100:00100000:1.0:1789438291.891476:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749821312 00010000:00010000:1.0:1789438291.891517:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925c07 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa51d expref: 9 pid: 6681 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438291.891581:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 83 00000100:00100000:1.0:1789438291.891592:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa714000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+9:2353:x1876361749821312:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789438291.891607:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438291.891631:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925c07 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa51d expref: 9 pid: 6681 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.891645:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925c07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa51d expref: 9 pid: 6681 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.891670:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789438291.891675:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789438291.891680:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa7c4ee9/0x7a8dd0fcbb925c2a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.891690:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa7c4ee9/0x7a8dd0fcbb925c2a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.891813:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438291.891912:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa714000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1274be99-2d57-4dac-a13e-a89426512ee0+9:2353:x1876361749821312:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 321us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438291.891925:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 83 00010000:00010000:2.0:1789438291.892324:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925c07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa51d expref: 8 pid: 6681 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438291.892341:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876361769726720:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789438291.892363:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fa7c4ee9/0x7a8dd0fcbb925c2a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.892374:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fa7c4ee9/0x7a8dd0fcbb925c2a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.892381:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa7c4ee9/0x7a8dd0fcbb925c2a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.892408:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fa7c4ee9/0x7a8dd0fcbb925c2a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.892431:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa7c4ee9/0x7a8dd0fcbb925c2a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.892439:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa7c4ee9/0x7a8dd0fcbb925c2a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.892446:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c69e1a00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:2.0:1789438291.892451:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa7c4ee9/0x7a8dd0fcbb925c2a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.892461:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa7c4ee9/0x7a8dd0fcbb925c2a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.892474:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa7c4ee9/0x7a8dd0fcbb925c2a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.892481:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa7c4ee9/0x7a8dd0fcbb925c2a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438291.892533:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa716300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1274be99-2d57-4dac-a13e-a89426512ee0+7:2356:x1876361749821184:12345-192.168.206.9@tcp:1:lhsmtool_posix.0 Request processed in 6117us (6308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438291.892541:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 69 00000100:00100000:3.0:1789438291.898528:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438291.898624:0:12507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749821568 00000100:00100000:0.0:1789438291.898635:0:12507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749821568 00000100:00100000:0.0:1789438291.898697:0:12507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 229 00000100:00100000:0.0:1789438291.898728:0:12507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1274be99-2d57-4dac-a13e-a89426512ee0+19:11617:x1876361749821568:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789438291.898811:0:12507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925c31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.898828:0:12507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925c31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.898869:0:12507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925c31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.899393:0:12507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb925c38 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.899407:0:12507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb925beb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa508 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.899415:0:12507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb925c38 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.899450:0:12507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb925beb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa508 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.899464:0:12507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb925beb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa508 expref: 20 pid: 5839 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438291.899480:0:12507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff939500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12507:1876361769726848:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789438291.899567:0:12507:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c7e88840 going to sleep for 11 seconds 00000100:00100000:3.0:1789438291.902344:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438291.902594:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749821696 00000100:00100000:2.0:1789438291.902604:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749821696 00010000:00010000:2.0:1789438291.902645:0:8438:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb925beb lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa508 expref: 21 pid: 5839 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438291.902697:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 84 00000100:00100000:2.0:1789438291.902733:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa717b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1274be99-2d57-4dac-a13e-a89426512ee0+21:2353:x1876361749821696:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789438291.902751:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438291.902758:0:8438:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb925beb lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa508 expref: 21 pid: 5839 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.902771:0:8438:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb925beb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa508 expref: 21 pid: 5839 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.902793:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9991c3ac2c00) 00010000:00010000:2.0:1789438291.902799:0:8438:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb925c38 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.902808:0:8438:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb925c38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.902816:0:8438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb925c38 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.902835:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789438291.902886:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa717b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1274be99-2d57-4dac-a13e-a89426512ee0+21:2353:x1876361749821696:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 180us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438291.902894:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 84 00010000:00010000:0.0:1789438291.904496:0:12507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb925beb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa508 expref: 20 pid: 5839 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438291.904519:0:12507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff939500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12507:1876361769726848:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438291.904542:0:12507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb925c38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.904551:0:12507:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb925c38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.904571:0:12507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb925c38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789438291.904938:0:12507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1789438291.905100:0:12507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1789438291.905158:0:12507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1789438291.905244:0:12507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff939500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12507:1876361769726976:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789438291.905306:0:12507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438291.905344:0:12507:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fa9f1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789438291.905541:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769726976 00000100:00100000:3.0:1789438291.905549:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769726976 00000100:00100000:3.0:1789438291.905602:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789438291.905612:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12507:x1876361769726976:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789438291.905698:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12507:x1876361769726976:12345-0@lo:1000:mdt00_004.0 Request processed in 88us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438291.905743:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789438291.905850:0:12507:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:1.0:1789438291.905856:0:12507:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:1.0:1789438291.905880:0:12507:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9991f3d2ce00 x1876361769726336/t4294967321(4294967321) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789438307 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789438291.905902:0:12507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff939500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12507:1876361769726976:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1789438291.906352:0:12507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1789438291.906415:0:12507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12507:1876361769727104:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789438291.906451:0:12507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438291.906480:0:12507:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f47de3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438291.906684:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769727104 00000100:00100000:3.0:1789438291.906690:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769727104 00000100:00100000:3.0:1789438291.906737:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789438291.906745:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12507:x1876361769727104:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789438291.906952:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:12507:x1876361769727104:12345-0@lo:1000:mdt00_004.0 Request processed in 208us (499us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1789438291.906960:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789438291.907280:0:12507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12507:1876361769727104:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1789438291.907315:0:12507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb925c38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.907326:0:12507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb925c38 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.907333:0:12507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb925c38 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.907339:0:12507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d62200 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438291.907344:0:12507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb925c38 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.907352:0:12507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb925c38 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.907366:0:12507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9991c3ac2c00) 00010000:00010000:1.0:1789438291.907369:0:12507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789438291.907374:0:12507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb925c38 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.907380:0:12507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62200/0x7a8dd0fcbb925c38 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.907420:0:12507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925b7b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.907426:0:12507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925b7b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.907432:0:12507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925b7b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.907436:0:12507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d62c00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438291.907439:0:12507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925b7b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.907444:0:12507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925b7b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.907451:0:12507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:1.0:1789438291.907453:0:12507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789438291.907460:0:12507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb925b82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4ec expref: 23 pid: 12507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.907471:0:12507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb925b82 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4ec expref: 23 pid: 12507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.907480:0:12507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb925b82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4ec expref: 23 pid: 12507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.907508:0:12507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb925b82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4ec expref: 23 pid: 12507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438291.907533:0:12507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12507:1876361769727232:192.168.206.9@tcp:105: 00000100:00100000:1.0:1789438291.907604:0:12507:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f47de3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438291.910523:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438291.910674:0:12507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12507:1876361769727232:192.168.206.9@tcp:105: 00010000:00010000:0.0:1789438291.910703:0:12507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925b7b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.910745:0:12507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb925b7b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.910779:0:12507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb925c3f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.910793:0:12507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb925c3f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.910804:0:12507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb925c3f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.910814:0:12507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb925c3f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.910820:0:12507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb925c3f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.910842:0:12507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb925c3f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.910848:0:12507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63600 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438291.910851:0:12507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb925c3f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.910858:0:12507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb925c3f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.910869:0:12507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:0.0:1789438291.910872:0:12507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438291.910875:0:12507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb925c3f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.910881:0:12507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63600/0x7a8dd0fcbb925c3f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.910891:0:12507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925c31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.910897:0:12507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925c31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.910903:0:12507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925c31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.910908:0:12507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438291.910911:0:12507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925c31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438291.911090:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749821824 00000100:00100000:3.0:1789438291.911098:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749821824 00000100:00100000:3.0:1789438291.911262:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 61 00000100:00100000:3.0:1789438291.911274:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+24:11616:x1876361749821824:12345-192.168.206.9@tcp:49:lfs.0 00000100:00100000:3.0:1789438291.911395:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+24:11616:x1876361749821824:12345-192.168.206.9@tcp:49:lfs.0 Request processed in 123us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438291.911403:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 61 00010000:00010000:0.0:1789438291.911444:0:12507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925c31 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.911456:0:12507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:0.0:1789438291.911459:0:12507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789438291.911462:0:12507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925c31 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.911468:0:12507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb925c31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438291.913494:0:12507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1274be99-2d57-4dac-a13e-a89426512ee0+23:11617:x1876361749821568:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 14779us (14968us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1789438291.913508:0:12507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 229 00000020:00080000:1.0:1789438291.913512:0:12507:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789438291.913678:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789438291.913683:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789438291.914206:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789438291.914214:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789438291.917260:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438291.917353:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749822080 00000100:00100000:3.0:1789438291.917363:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749822080 00000100:00100000:3.0:1789438291.917425:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 230 00000100:00100000:3.0:1789438291.917436:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+23:11616:x1876361749822080:12345-192.168.206.9@tcp:58:lfs.0 00000040:00080000:3.0:1789438291.918003:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1789438291.918124:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+23:11616:x1876361749822080:12345-192.168.206.9@tcp:58:lfs.0 Request processed in 681us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438291.918133:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 230 00000100:00100000:2.0:1789438291.919353:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438291.920043:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749822336 00000100:00100000:1.0:1789438291.920053:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749822336 00000100:00100000:1.0:1789438291.920101:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 62 00000100:00100000:1.0:1789438291.920110:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d21bbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+23:11617:x1876361749822336:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789438291.924014:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789438291.924451:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1789438291.924520:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925c46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.924538:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925c46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.924550:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925c46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.924559:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925c46 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.924565:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925c46 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.924586:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925c46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438291.924620:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789438291.924756:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d21bbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+25:11617:x1876361749822336:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 Request processed in 4642us (5406us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1789438291.924766:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 62 00000020:00080000:1.0:1789438291.924773:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789438291.927507:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789438291.927520:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925c46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.927532:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dae00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:2.0:1789438291.927536:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925c46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.927546:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925c46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.927564:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9991c7c83600) 00010000:00010000:2.0:1789438291.927567:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789438291.927572:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925c46 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.927579:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9dae00/0x7a8dd0fcbb925c46 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438291.927603:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438291.927605:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438291.927607:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438291.952024:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438291.952205:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749822464 00000100:00100000:3.0:1789438291.952216:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749822464 00000100:00100000:3.0:1789438291.952290:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 231 00000100:00100000:3.0:1789438291.952301:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff93ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+25:11619:x1876361749822464:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:3.0:1789438291.952325:0:7624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438291.952346:0:7624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb925c4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa524 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.952409:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb925c54 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.952423:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb925c54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.952433:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb925c54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.952446:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925c5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.952453:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.952459:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.952682:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb925c62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.952694:0:7624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1200/0x7a8dd0fcbb925b6d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4e5 expref: 26 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.952701:0:7624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb925c62 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.952782:0:7624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1200/0x7a8dd0fcbb925b6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4e5 expref: 26 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.952795:0:7624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1200/0x7a8dd0fcbb925b6d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4e5 expref: 26 pid: 5838 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438291.952810:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d04b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7624:1876361769727360:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789438291.953487:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991ff88d600 going to sleep for 11 seconds 00000100:00100000:1.0:1789438291.958255:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438291.958411:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d04b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7624:1876361769727360:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789438291.958435:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749822720 00010000:00010000:3.0:1789438291.958439:0:7624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb925c62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438291.958444:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749822720 00000100:00100000:0.0:1789438291.958814:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 63 00000100:00100000:0.0:1789438291.958829:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+27:5593:x1876361749822720:12345-192.168.206.9@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789438291.959169:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+28:5593:x1876361749822720:12345-192.168.206.9@tcp:35:ldlm_bl.0 Request processed in 342us (922us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1789438291.959177:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 63 00000100:00100000:0.0:1789438291.961378:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438291.961475:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749822848 00000100:00100000:3.0:1789438291.961484:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749822848 00010000:00010000:3.0:1789438291.961525:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1200/0x7a8dd0fcbb925b6d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4e5 expref: 28 pid: 5838 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438291.961614:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 85 00000100:00100000:3.0:1789438291.961625:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff93b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+28:2353:x1876361749822848:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789438291.961639:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438291.961647:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1200/0x7a8dd0fcbb925b6d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4e5 expref: 28 pid: 5838 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.961662:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1200/0x7a8dd0fcbb925b6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4e5 expref: 28 pid: 5838 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.961738:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1200/0x7a8dd0fcbb925b6d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4e5 expref: 28 pid: 5838 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.961754:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:3.0:1789438291.961760:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb925c62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.961769:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb925c62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.961776:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb925c62 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438291.961801:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789438291.961875:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff93b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1274be99-2d57-4dac-a13e-a89426512ee0+27:2353:x1876361749822848:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 251us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438291.961882:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 85 00010000:00010000:0.0:1789438291.962086:0:7624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb925c62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.962095:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb925c62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438291.962145:0:7624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789438291.962149:0:7624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789438291.962169:0:7624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb925c62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.962187:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb925c62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.962197:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb925c54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.962203:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb925c54 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.962209:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb925c54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.962215:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438291.962219:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb925c54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.962225:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb925c54 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.962234:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:0.0:1789438291.962237:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438291.962240:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb925c54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.962245:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54800/0x7a8dd0fcbb925c54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.962255:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.962261:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925c5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.962271:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925c5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.962275:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438291.962278:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925c5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.962283:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925c5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.962290:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9991d192ce00) 00010000:00010000:0.0:1789438291.962292:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438291.962295:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925c5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.962300:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54400/0x7a8dd0fcbb925c5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.962334:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55800/0x7a8dd0fcbb925c4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa524 expref: 27 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.962346:0:7624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb925c62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa524 expref: 26 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438291.962353:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:0.0:1789438291.962355:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789438291.962357:0:7624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a55200, rc 0) 00000100:00100000:0.0:1789438291.962396:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff93ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+26:11619:x1876361749822464:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 10097us (10382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438291.962411:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 231 00000040:00080000:2.0:1789438292.790236:0:12545:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789438292.790246:0:12545:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789438292.790286:0:12545:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789438292.790291:0:12545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1789438292.825103:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1789438292.825255:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:0.0:1789438292.856124:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789438292.918948:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789438292.918956:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789438292.919003:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789438292.919016:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789438292.919142:0:11668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11668:1876361769727488:192.168.206.9@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789438292.919272:0:11668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9990c2219540 going to sleep for 11 seconds 00000100:00100000:3.0:1789438292.931110:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438292.931146:0:12507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749822976 00000100:00100000:3.0:1789438292.931155:0:12507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749822976 00000100:00100000:3.0:1789438292.931218:0:12507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 232 00000100:00100000:3.0:1789438292.931230:0:12507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d04b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1274be99-2d57-4dac-a13e-a89426512ee0+27:11631:x1876361749822976:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789438292.931264:0:12507:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789438292.931367:0:12507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d04b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1274be99-2d57-4dac-a13e-a89426512ee0+27:11631:x1876361749822976:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 Request processed in 140us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438292.931375:0:12507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 232 00000100:00100000:1.0:1789438292.931459:0:11668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11668:1876361769727488:192.168.206.9@tcp:107:hsm_cdtr.0 00000100:00080000:3.0:1789438292.935437:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789438292.946404:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438292.946454:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749823232 00000100:00100000:2.0:1789438292.946466:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749823232 00000100:00100000:2.0:1789438292.946527:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 233 00000100:00100000:2.0:1789438292.946538:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+26:11631:x1876361749823232:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789438292.946558:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438292.946578:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb925c69 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa52b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438292.946679:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0400/0x7a8dd0fcbb925c70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438292.946694:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0400/0x7a8dd0fcbb925c70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438292.946704:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0400/0x7a8dd0fcbb925c70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438292.946734:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789438292.946858:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb925c69 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa52b expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438292.946878:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0400/0x7a8dd0fcbb925c70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa52b expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438292.946887:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:2.0:1789438292.946902:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789438292.946906:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c69e0400, rc 0) 00000100:00100000:2.0:1789438292.946965:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+28:11631:x1876361749823232:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 429us (573us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1789438292.946972:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 233 00000100:00100000:0.0:1789438292.955337:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438292.955383:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438292.955412:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749823616 00000100:00100000:0.0:1789438292.955422:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749823616 00000100:00100000:0.0:1789438292.955482:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 17 00000100:00100000:0.0:1789438292.955493:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff938e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1274be99-2d57-4dac-a13e-a89426512ee0+28:2353:x1876361749823616:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789438292.955509:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438292.955535:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0400/0x7a8dd0fcbb925c70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa52b expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438292.955554:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:0.0:1789438292.955559:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438292.955612:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff938e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1274be99-2d57-4dac-a13e-a89426512ee0+27:2353:x1876361749823616:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 120us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438292.955620:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 17 00000100:00100000:3.0:1789438292.956149:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749823488 00000100:00100000:3.0:1789438292.956156:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749823488 00000100:00100000:3.0:1789438292.956197:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 234 00000100:00100000:3.0:1789438292.956205:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+27:11631:x1876361749823488:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789438292.956272:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb925c7e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438292.956287:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb925c7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438292.956299:0:7624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb925c7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438292.956474:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb925c7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438292.956482:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb925c7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438292.956488:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb925c7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438292.956493:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54a00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438292.956497:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb925c7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438292.956505:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb925c7e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438292.956515:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:3.0:1789438292.956519:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789438292.956523:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb925c7e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438292.956537:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a54a00/0x7a8dd0fcbb925c7e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438292.956659:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+28:11631:x1876361749823488:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 455us (1331us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1789438292.956666:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 234 00000040:00080000:0.0:1789438292.956918:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789438292.956922:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789438292.957424:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789438292.957432:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789438292.963030:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438292.967637:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749823872 00000100:00100000:0.0:1789438292.967651:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749823872 00000100:00100000:2.0:1789438292.967918:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 64 00000100:00100000:2.0:1789438292.967930:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+28:11631:x1876361749823872:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789438292.968426:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+29:11631:x1876361749823872:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 Request processed in 497us (5470us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1789438292.968435:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 64 00010000:00010000:1.0:1789438293.879345:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438294.329947:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876361769727744:0@lo:400:kworker.0 00000100:00100000:3.0:1789438294.329969:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769727872:0@lo:400:kworker.0 00000100:00100000:1.0:1789438294.330692:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d04b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769727616:0@lo:400:kworker.0 00000100:00100000:2.0:1789438294.333115:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438294.333263:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769728256:0@lo:400:kworker.0 00000100:00100000:2.0:1789438294.333305:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438294.333351:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769728000:0@lo:400:kworker.0 00000100:00100000:2.0:1789438294.333375:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438294.333410:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769728256 00000100:00100000:2.0:1789438294.333419:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769728256 00000100:00100000:2.0:1789438294.333473:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769728000 00000100:00100000:2.0:1789438294.333476:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769728000 00000100:00100000:2.0:1789438294.333504:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789438294.333514:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1876361769728256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438294.333568:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1876361769728256:12345-0@lo:400:kworker.0 Request processed in 56us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438294.333575:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789438294.333606:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789438294.333612:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769728000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438294.333645:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769728000:12345-0@lo:400:kworker.0 Request processed in 33us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438294.333651:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1789438294.333667:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789438294.333671:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789438294.335106:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1789438294.335117:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1789438294.335208:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9991ff939880, transno 4294967310 00000100:00100000:2.0:1789438294.335235:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769728000:0@lo:400:kworker.0 00000100:00100000:2.0:1789438294.335516:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769728256:0@lo:400:kworker.0 00000100:00100000:3.0:1789438294.337608:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438294.337666:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769727744 00000100:00100000:3.0:1789438294.337675:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769727744 00000100:00100000:3.0:1789438294.340323:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769727872 00000100:00100000:3.0:1789438294.340337:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769727872 00000100:00100000:3.0:1789438294.340388:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789438294.340399:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876361769727744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438294.340494:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876361769727744:12345-0@lo:400:kworker.0 Request processed in 98us (7383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438294.340502:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789438294.340520:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789438294.340527:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769727872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438294.340557:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769727872:12345-0@lo:400:kworker.0 Request processed in 30us (2955us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438294.340562:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:3.0:1789438294.340588:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789438294.340626:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876361769727744:0@lo:400:kworker.0 00000100:00100000:3.0:1789438294.340679:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769727872:0@lo:400:kworker.0 00000100:00100000:1.0:1789438294.340838:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438294.340884:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769728128:0@lo:400:kworker.0 00000100:00100000:1.0:1789438294.341036:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438294.341166:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769727616 00000100:00100000:3.0:1789438294.341171:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769727616 00000100:00100000:3.0:1789438294.341209:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789438294.341217:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3311:x1876361769727616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438294.341257:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3311:x1876361769727616:12345-0@lo:400:kworker.0 Request processed in 40us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438294.341263:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1789438294.341411:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d04b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769727616:0@lo:400:kworker.0 00000100:00100000:2.0:1789438294.344302:0:12507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769728128 00000100:00100000:2.0:1789438294.344318:0:12507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769728128 00000100:00100000:3.0:1789438294.347835:0:12507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789438294.347849:0:12507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769728128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438294.347954:0:12507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769728128:12345-0@lo:400:kworker.0 Request processed in 108us (6917us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438294.347961:0:12507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789438294.348033:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769728128:0@lo:400:kworker.0 00000100:00080000:1.0:1789438294.348257:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1789438294.681815:0:12598:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789438294.681827:0:12598:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789438294.681877:0:12598:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789438294.681885:0:12598:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789438294.839163:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789438294.839186:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769728384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789438294.839255:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438294.839319:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769728384 00000100:00100000:2.0:1789438294.839327:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769728384 00000100:00100000:2.0:1789438294.839374:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789438294.839382:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769728384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789438294.839418:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789438294.839464:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769728384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438294.839472:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789438294.839524:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769728384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789438294.842324:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:1.0:1789438294.842366:0:8102:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 347107657556ns, next at 348107655355ns, rc = 0 00000100:00100000:0.0:1789438294.843838:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769728512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789438294.843915:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438294.846251:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769728512 00000100:00100000:1.0:1789438294.846265:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769728512 00000100:00100000:1.0:1789438294.846324:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789438294.846335:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1876361769728512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789438294.846377:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789438294.846456:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1876361769728512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (2539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438294.846464:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789438294.846880:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769728512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789438294.855609:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438294.855647:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749824128 00000100:00100000:0.0:1789438294.855656:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749824128 00000100:00100000:0.0:1789438294.855748:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 235 00000100:00100000:0.0:1789438294.855759:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff93a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+29:11652:x1876361749824128:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:0.0:1789438294.855782:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438294.855801:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925c85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa532 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438294.855895:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925c8c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438294.858022:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925c8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438294.858048:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925c8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438294.858067:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789438294.858289:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63200/0x7a8dd0fcbb925c85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa532 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438294.858309:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925c8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa532 expref: 31 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438294.858317:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:0.0:1789438294.858320:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789438294.858324:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63400, rc 0) 00000100:00100000:0.0:1789438294.858382:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff93a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1274be99-2d57-4dac-a13e-a89426512ee0+31:11652:x1876361749824128:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 2624us (2779us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1789438294.858398:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 235 00000100:00080000:1.0:1789438294.859118:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789438294.864448:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438294.866793:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749824256 00000100:00100000:3.0:1789438294.866809:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749824256 00000100:00100000:3.0:1789438294.866879:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 236 00000100:00100000:3.0:1789438294.866891:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+31:11652:x1876361749824256:12345-192.168.206.9@tcp:54:lfs.0 00010000:00010000:3.0:1789438294.866959:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925c9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438294.866977:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925c9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438294.867002:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925c9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438294.867029:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925c9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438294.867041:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925c9a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438294.867047:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925c9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438294.867053:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55a00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438294.867057:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925c9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438294.867065:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925c9a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438294.867077:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:3.0:1789438294.867079:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789438294.867085:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925c9a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438294.867090:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb925c9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438294.867169:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1274be99-2d57-4dac-a13e-a89426512ee0+31:11652:x1876361749824256:12345-192.168.206.9@tcp:54:lfs.0 Request processed in 279us (2729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438294.867177:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 236 00010000:00010000:2.0:1789438294.903396:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438294.975811:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438294.975963:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749824384 00000100:00100000:3.0:1789438294.975974:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749824384 00000100:00080000:1.0:1789438294.976058:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789438294.976301:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 70 00000100:00100000:3.0:1789438294.976313:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1274be99-2d57-4dac-a13e-a89426512ee0+7:2356:x1876361749824384:12345-192.168.206.9@tcp:101:cat.0 00010000:00010000:3.0:1789438294.976331:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438294.976361:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e473c913/0x7a8dd0fcbb925ca1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa539 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789438294.976387:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa8a953, atime: 0x6aa8a952, ctime: 0x6aa8a953, blocks: 0xb 00010000:00010000:3.0:1789438294.976409:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=347s v=(0 0) 00010000:00010000:3.0:1789438294.976414:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438294.976424:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e473c913/0x7a8dd0fcbb925ca1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa539 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438294.976442:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e473c913/0x7a8dd0fcbb925ca1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa539 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438294.976456:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a54a00, rc 0) 00000100:00100000:3.0:1789438294.976526:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1274be99-2d57-4dac-a13e-a89426512ee0+8:2356:x1876361749824384:12345-192.168.206.9@tcp:101:cat.0 Request processed in 215us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438294.976533:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 70 00000100:00100000:2.0:1789438294.984805:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438294.984888:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749824512 00000100:00100000:1.0:1789438294.984900:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749824512 00002000:00100000:1.0:1789438294.984947:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9991f3d2dc00 x1876361749824512/t0(0) o3->1274be99-2d57-4dac-a13e-a89426512ee0@192.168.206.9@tcp:725/0 lens 488/0 e 0 to 0 dl 1789438305 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789438294.984959:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9991f3d2dc00 with x1876361749824512 ext(0->4095) 00002000:00010000:1.0:1789438294.984966:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9991f3d2dc00 00000100:00100000:1.0:1789438294.985005:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:1.0:1789438294.985016:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1274be99-2d57-4dac-a13e-a89426512ee0+8:2354:x1876361749824512:12345-192.168.206.9@tcp:3:cat.0 00000100:00100000:1.0:1789438294.985222:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1274be99-2d57-4dac-a13e-a89426512ee0+8:2354:x1876361749824512:12345-192.168.206.9@tcp:3:cat.0 Request processed in 207us (426us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789438294.985230:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 7 00002000:00100000:1.0:1789438294.985237:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9991f3d2dc00 x1876361749824512/t0(0) o3->1274be99-2d57-4dac-a13e-a89426512ee0@192.168.206.9@tcp:725/0 lens 488/4536 e 0 to 0 dl 1789438305 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789438294.985245:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9991f3d2dc00 with x1876361749824512 ext(0->4095) 00002000:00010000:1.0:1789438294.985249:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9991f3d2dc00 00010000:00010000:0.0:1789438295.937861:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438296.537916:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438296.537988:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438296.538031:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749824640 00000100:00100000:3.0:1789438296.538042:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749824640 00000100:00100000:1.0:1789438296.538064:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749824768 00000100:00100000:1.0:1789438296.538071:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749824768 00000100:00100000:3.0:1789438296.538107:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 293 00000100:00100000:3.0:1789438296.538119:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+13:2356:x1876361749824640:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438296.538128:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 155 00000100:00100000:1.0:1789438296.538141:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+31:2356:x1876361749824768:12345-192.168.206.9@tcp:400:kworker.0 00000100:00080000:0.0:1789438296.538147:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789438296.538204:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+13:2356:x1876361749824640:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 83us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438296.538205:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+31:2356:x1876361749824768:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 63us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438296.538222:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 293 00000100:00100000:1.0:1789438296.538223:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 155 00000100:00100000:1.0:1789438296.540096:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438296.540143:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438296.540246:0:11995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749824896 00000100:00100000:2.0:1789438296.540252:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749825024 00000100:00100000:0.0:1789438296.540256:0:11995:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749824896 00000100:00100000:2.0:1789438296.540259:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749825024 00000100:00080000:1.0:1789438296.540358:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789438296.540363:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789438296.540401:0:11995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 91 00000100:00100000:0.0:1789438296.540413:0:11995:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1274be99-2d57-4dac-a13e-a89426512ee0+5:2356:x1876361749824896:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789438296.540488:0:11995:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1274be99-2d57-4dac-a13e-a89426512ee0+5:2356:x1876361749824896:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 78us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438296.540495:0:11995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 91 00000100:00100000:0.0:1789438296.540512:0:11995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 92 00000100:00100000:0.0:1789438296.540518:0:11995:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1274be99-2d57-4dac-a13e-a89426512ee0+8:2356:x1876361749825024:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789438296.540542:0:11995:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1274be99-2d57-4dac-a13e-a89426512ee0+8:2356:x1876361749825024:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 25us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438296.540548:0:11995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 92 00000100:00100000:1.0:1789438296.541128:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438296.543267:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749825152 00000100:00100000:0.0:1789438296.543281:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749825152 00000100:00100000:0.0:1789438296.543355:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 156 00000100:00100000:0.0:1789438296.543366:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2355:x1876361749825152:12345-192.168.206.9@tcp:400:kworker.0 00000100:00080000:1.0:1789438296.543640:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789438296.543742:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2355:x1876361749825152:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 377us (2614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438296.543750:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 156 00010000:00010000:1.0:1789438296.955315:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789438296.999698:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:0.0:1789438296.999750:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:0.0:1789438296.999756:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:0.0:1789438297.001881:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000004:00080000:0.0:1789438297.001916:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:0.0:1789438297.001947:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9991f47de540 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1789438297.001953:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9991f3d34c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9991f47def00 00000020:00080000:0.0:1789438297.001956:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9991f3d34a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9991ffa05800 00000020:00080000:0.0:1789438297.001966:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1789438297.002172:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1789438297.002394:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1789438297.002405:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789438297.002428:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769728640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789438297.002499:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438297.002570:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769728640 00000100:00100000:1.0:1789438297.002578:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769728640 00000100:00100000:1.0:1789438297.002632:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789438297.002641:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769728640:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789438297.002863:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789438297.002867:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789438291 -> 1789438291 00002000:00010000:1.0:1789438297.002870:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1789438290 -> 1789438290 00002000:00010000:1.0:1789438297.002872:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789438291 -> 1789438291 00002000:00010000:1.0:1789438297.002874:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789438297.002937:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1876361769728640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 296us (437us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1789438297.002944:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1789438297.002994:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789438297.003028:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:1.0:1789438297.003034:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9991f3d2ce00, transno 4294967321 00000004:00080000:1.0:1789438297.003043:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:1.0:1789438297.003064:0:3312:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9991faab5c00 x1876361769728640/t4294967324(4294967324) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789438313 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789438297.003075:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9991faab5c00/2, rc 0, transno 4294967324 00000100:00100000:1.0:1789438297.003080:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769728640:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1789438297.975738:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438298.999036:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438299.447442:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769729152:0@lo:400:kworker.0 00000100:00100000:2.0:1789438299.447514:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438299.447571:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789438299.447578:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769728768:0@lo:400:kworker.0 00000100:00100000:2.0:1789438299.447607:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438299.447629:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769729280:0@lo:400:kworker.0 00000100:00100000:2.0:1789438299.447652:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438299.447677:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769728896:0@lo:400:kworker.0 00000100:00100000:2.0:1789438299.447749:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438299.447768:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769729408:0@lo:400:kworker.0 00000100:00100000:2.0:1789438299.447788:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438299.447806:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789438299.447811:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769729024:0@lo:400:kworker.0 00000100:00100000:2.0:1789438299.447832:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438299.447876:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769729152 00000100:00100000:2.0:1789438299.447884:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769729152 00000100:00100000:2.0:1789438299.448942:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769729408 00000100:00100000:2.0:1789438299.448951:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769729408 00000100:00100000:2.0:1789438299.449001:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789438299.449012:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769729152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438299.449087:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769729152:12345-0@lo:400:kworker.0 Request processed in 78us (1572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438299.449107:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789438299.449125:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789438299.449132:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1876361769729408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438299.449170:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1876361769729408:12345-0@lo:400:kworker.0 Request processed in 38us (1380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438299.449175:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789438299.449212:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769728768 00000100:00100000:2.0:1789438299.449217:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769728768 00000100:00100000:2.0:1789438299.449243:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1789438299.449249:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3311:x1876361769728768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438299.449279:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3311:x1876361769728768:12345-0@lo:400:kworker.0 Request processed in 31us (1671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438299.449285:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1789438299.449317:0:12507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769729280 00000100:00100000:2.0:1789438299.449321:0:12507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769729280 00000100:00100000:2.0:1789438299.449346:0:12507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769728896 00000100:00100000:2.0:1789438299.449349:0:12507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769728896 00000100:00100000:2.0:1789438299.449365:0:12507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769729024 00000100:00100000:2.0:1789438299.449368:0:12507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769729024 00000100:00100000:2.0:1789438299.449383:0:12507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789438299.449390:0:12507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769729280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438299.449421:0:12507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769729280:12345-0@lo:400:kworker.0 Request processed in 33us (1768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438299.449427:0:12507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789438299.449438:0:12507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789438299.449443:0:12507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769728896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438299.449489:0:12507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769728896:12345-0@lo:400:kworker.0 Request processed in 45us (1738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438299.449490:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789438299.449500:0:12507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789438299.449506:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769729024:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789438299.449537:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789438299.449544:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789438299.449547:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789438299.449552:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769729024:12345-0@lo:400:kworker.0 Request processed in 50us (1716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438299.449559:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789438299.449614:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769729024:0@lo:400:kworker.0 00000100:00100000:2.0:1789438299.449627:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769728896:0@lo:400:kworker.0 00000100:00100000:2.0:1789438299.449639:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769729408:0@lo:400:kworker.0 00000100:00100000:2.0:1789438299.449677:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769728768:0@lo:400:kworker.0 00000100:00100000:2.0:1789438299.449688:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769729280:0@lo:400:kworker.0 00000100:00100000:2.0:1789438299.449699:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769729152:0@lo:400:kworker.0 00000100:00100000:1.0:1789438299.690046:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438299.690238:0:12507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749825280 00000100:00100000:2.0:1789438299.690249:0:12507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749825280 00000100:00100000:2.0:1789438299.690338:0:12507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 237 00000100:00100000:2.0:1789438299.690349:0:12507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1274be99-2d57-4dac-a13e-a89426512ee0+18:11297:x1876361749825280:12345-192.168.206.9@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789438299.690457:0:12507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1274be99-2d57-4dac-a13e-a89426512ee0+18:11297:x1876361749825280:12345-192.168.206.9@tcp:60:lhsmtool_posix.0 Request processed in 109us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438299.690465:0:12507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 237 00000100:00080000:1.0:1789438299.690982:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789438299.695187:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438299.695477:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749825536 00000100:00100000:2.0:1789438299.695489:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749825536 00000100:00100000:2.0:1789438299.695554:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 65 00000100:00100000:2.0:1789438299.695565:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+18:11297:x1876361749825536:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789438299.696435:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+19:11297:x1876361749825536:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 Request processed in 866us (1251us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1789438299.696445:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 65 00000100:00100000:3.0:1789438299.959322:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789438299.959346:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769729536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789438299.959434:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438299.960400:0:10069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769729536 00000100:00100000:2.0:1789438299.960412:0:10069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769729536 00000100:00100000:2.0:1789438299.960477:0:10069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789438299.960487:0:10069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769729536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789438299.960522:0:10069:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789438299.960588:0:10069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769729536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438299.960606:0:10069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789438299.961059:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789438299.961074:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769729664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789438299.961126:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438299.961268:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769729664 00000100:00100000:1.0:1789438299.961274:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769729664 00000100:00100000:1.0:1789438299.961320:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789438299.961328:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876361769729664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789438299.961349:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789438299.961390:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876361769729664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438299.961396:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789438299.961440:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769729664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789438299.962208:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769729536:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789438300.025042:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438301.050027:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789438301.180877:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789438301.180887:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789438301.181173:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1789438301.181180:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:3.0:1789438301.462254:0:12798:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 22:11:39 (1789438299) 00000100:00100000:1.0:1789438301.657223:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438301.657295:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749825664 00000100:00100000:0.0:1789438301.657306:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749825664 00000100:00100000:0.0:1789438301.657369:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 295 00000100:00100000:0.0:1789438301.657380:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+13:2354:x1876361749825664:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789438301.657451:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+13:2354:x1876361749825664:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 73us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438301.657467:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 295 00000100:00100000:1.0:1789438301.668364:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438301.668410:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438301.668438:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438301.668477:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438301.668505:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749826048 00000100:00100000:1.0:1789438301.668522:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749826048 00000100:00100000:1.0:1789438301.668583:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749825920 00000100:00100000:1.0:1789438301.668586:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749825920 00000100:00100000:1.0:1789438301.668612:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 95 00000100:00100000:1.0:1789438301.668622:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+7:2353:x1876361749826048:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438301.668740:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+7:2353:x1876361749826048:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 82us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438301.668749:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 95 00000100:00100000:1.0:1789438301.668767:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 96 00000100:00100000:1.0:1789438301.668774:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+5:2353:x1876361749825920:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438301.668801:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1274be99-2d57-4dac-a13e-a89426512ee0+5:2353:x1876361749825920:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 28us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438301.668807:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 96 00000100:00080000:1.0:1789438301.668824:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789438301.668828:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789438301.669071:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749825792 00000100:00100000:2.0:1789438301.669076:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749825792 00000100:00100000:2.0:1789438301.669213:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749826176 00000100:00100000:2.0:1789438301.669217:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749826176 00000100:00100000:2.0:1789438301.669243:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 160 00000100:00100000:2.0:1789438301.669249:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+19:2354:x1876361749825792:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789438301.669294:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1274be99-2d57-4dac-a13e-a89426512ee0+19:2354:x1876361749825792:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 45us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438301.669301:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 160 00000100:00100000:2.0:1789438301.669315:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 161 00000100:00100000:2.0:1789438301.669321:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2353:x1876361749826176:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789438301.669347:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1969457-1646-49ba-87ff-a507cb42c3bf+5:2353:x1876361749826176:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 26us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438301.669363:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 161 00000100:00080000:1.0:1789438301.670049:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789438302.074924:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789438302.099321:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:2.0:1789438302.099344:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1789438302.099358:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1789438302.099367:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:2.0:1789438302.099628:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:1.0:1789438303.097881:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438303.814336:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438303.814443:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749826304 00000100:00100000:0.0:1789438303.814454:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749826304 00000100:00100000:0.0:1789438303.814541:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 238 00000100:00100000:0.0:1789438303.814553:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1969457-1646-49ba-87ff-a507cb42c3bf+5:12316:x1876361749826304:12345-192.168.206.9@tcp:101:lsof.0 00010000:00010000:0.0:1789438303.814574:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438303.814596:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925ca8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa540 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438303.814659:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925caf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438303.814672:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925caf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438303.814685:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925caf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438303.814769:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789438303.814773:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789438303.814812:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925caf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438303.814837:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb925ca8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa540 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438303.814857:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925caf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa540 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438303.814897:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:0.0:1789438303.814900:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789438303.814904:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63a00, rc 0) 00000100:00100000:0.0:1789438303.814969:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1969457-1646-49ba-87ff-a507cb42c3bf+6:12316:x1876361749826304:12345-192.168.206.9@tcp:101:lsof.0 Request processed in 419us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438303.814976:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 238 00000100:00080000:1.0:1789438303.815272:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789438304.121228:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438304.567135:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876361769730048:0@lo:400:kworker.0 00000100:00100000:3.0:1789438304.567214:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438304.567292:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789438304.567299:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876361769729920:0@lo:400:kworker.0 00000100:00100000:3.0:1789438304.567324:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438304.567344:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769730432:0@lo:400:kworker.0 00000100:00100000:3.0:1789438304.567368:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438304.567399:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769730048 00000100:00100000:3.0:1789438304.567407:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769730048 00000100:00100000:3.0:1789438304.567460:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789438304.567470:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876361769730048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438304.567523:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876361769730048:12345-0@lo:400:kworker.0 Request processed in 56us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438304.567530:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789438304.567547:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769729920 00000100:00100000:3.0:1789438304.567551:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769729920 00000100:00100000:3.0:1789438304.567585:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789438304.567857:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876361769729920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438304.567888:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876361769729920:12345-0@lo:400:kworker.0 Request processed in 298us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438304.567894:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789438304.567915:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769730432 00000100:00100000:3.0:1789438304.567929:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769730432 00000100:00100000:3.0:1789438304.567970:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789438304.567975:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769730432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438304.568004:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769730432:12345-0@lo:400:kworker.0 Request processed in 29us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438304.568009:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:3.0:1789438304.568026:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789438304.568030:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789438304.568057:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876361769729920:0@lo:400:kworker.0 00000100:00100000:3.0:1789438304.568066:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1789438304.568071:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9991faab5c00, transno 4294967324 00000100:00100000:3.0:1789438304.568079:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769730432:0@lo:400:kworker.0 00000100:00100000:3.0:1789438304.568089:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876361769730048:0@lo:400:kworker.0 00000100:00100000:2.0:1789438304.568311:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769730176:0@lo:400:kworker.0 00000100:00100000:2.0:1789438304.568348:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438304.568385:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789438304.568392:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769729792:0@lo:400:kworker.0 00000100:00100000:2.0:1789438304.568419:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438304.568439:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769730304:0@lo:400:kworker.0 00000100:00100000:2.0:1789438304.568456:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438304.568477:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769729792 00000100:00100000:2.0:1789438304.568481:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769729792 00000100:00100000:2.0:1789438304.568508:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1789438304.568514:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3311:x1876361769729792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438304.568544:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3311:x1876361769729792:12345-0@lo:400:kworker.0 Request processed in 30us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438304.568550:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1789438304.568600:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769730304 00000100:00100000:2.0:1789438304.568603:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769730304 00000100:00100000:2.0:1789438304.568631:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789438304.568637:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769730304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438304.568664:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769730304:12345-0@lo:400:kworker.0 Request processed in 28us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438304.568678:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789438304.568704:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769729792:0@lo:400:kworker.0 00000100:00100000:2.0:1789438304.568733:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769730304:0@lo:400:kworker.0 00000100:00100000:3.0:1789438304.568931:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769730176 00000100:00100000:3.0:1789438304.568944:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769730176 00000100:00100000:3.0:1789438304.568977:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789438304.568983:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769730176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438304.569018:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769730176:12345-0@lo:400:kworker.0 Request processed in 36us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438304.569024:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1789438304.569036:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789438304.569039:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789438304.569053:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769730176:0@lo:400:kworker.0 00000100:00100000:0.0:1789438305.080898:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789438305.080925:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769730560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789438305.081017:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438305.081594:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769730560 00000100:00100000:1.0:1789438305.081603:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769730560 00000100:00100000:1.0:1789438305.081666:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789438305.081676:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769730560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789438305.081733:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789438305.081790:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769730560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438305.081815:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789438305.081993:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769730688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789438305.082028:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438305.082124:0:10069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769730688 00000100:00100000:2.0:1789438305.082129:0:10069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769730688 00000100:00100000:2.0:1789438305.082163:0:10069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789438305.082170:0:10069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769730688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789438305.082191:0:10069:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789438305.082231:0:10069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769730688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438305.082237:0:10069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789438305.082523:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769730688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789438305.082776:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769730560:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789438305.143463:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438305.688451:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438305.688882:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749826560 00000100:00100000:1.0:1789438305.688893:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749826560 00000100:00100000:1.0:1789438305.688981:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 66 00000100:00100000:1.0:1789438305.688992:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+18:12317:x1876361749826560:12345-192.168.206.9@tcp:35:umount.0 00000100:00080000:3.0:1789438305.689350:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789438305.689514:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+19:12317:x1876361749826560:12345-192.168.206.9@tcp:35:umount.0 Request processed in 523us (1071us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1789438305.689524:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 66 00000100:00100000:1.0:1789438305.694405:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438305.694668:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749826816 00000100:00100000:2.0:1789438305.694680:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749826816 00000100:00100000:2.0:1789438305.694794:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 67 00000100:00100000:2.0:1789438305.694805:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+19:12317:x1876361749826816:12345-192.168.206.9@tcp:35:umount.0 00000100:00100000:2.0:1789438305.695481:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+20:12317:x1876361749826816:12345-192.168.206.9@tcp:35:umount.0 Request processed in 674us (1085us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789438305.695490:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 67 00000100:00100000:0.0:1789438305.701625:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438305.701809:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749827072 00000100:00100000:2.0:1789438305.701822:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749827072 00000100:00100000:2.0:1789438305.701988:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 68 00000100:00100000:2.0:1789438305.702002:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d21b8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+20:12317:x1876361749827072:12345-192.168.206.9@tcp:35:umount.0 00000100:00100000:2.0:1789438305.702357:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d21b8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1274be99-2d57-4dac-a13e-a89426512ee0+21:12317:x1876361749827072:12345-192.168.206.9@tcp:35:umount.0 Request processed in 356us (747us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1789438305.702384:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 68 00000100:00100000:3.0:1789438305.705281:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438305.712866:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749827328 00000100:00100000:1.0:1789438305.712889:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749827328 00000100:00100000:1.0:1789438305.712997:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 69 00000100:00100000:1.0:1789438305.713010:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+21:12317:x1876361749827328:12345-192.168.206.9@tcp:35:umount.0 00000100:00100000:1.0:1789438305.713473:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1274be99-2d57-4dac-a13e-a89426512ee0+22:12317:x1876361749827328:12345-192.168.206.9@tcp:35:umount.0 Request processed in 464us (8206us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1789438305.713483:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 69 00000100:00100000:3.0:1789438305.719498:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438305.719556:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438305.719595:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438305.720051:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749827456 00000100:00100000:2.0:1789438305.720065:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749827456 00000100:00100000:2.0:1789438305.720133:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749827712 00000100:00100000:2.0:1789438305.720137:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749827712 00000100:00100000:2.0:1789438305.720154:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749827584 00000100:00100000:2.0:1789438305.720158:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749827584 00000100:00100000:0.0:1789438305.720197:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 18 00000100:00100000:0.0:1789438305.720213:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d055e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58dec870-790c-4419-a02f-595f69c3b298+15:2353:x1876361749827456:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789438305.720235:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438305.720269:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991ff9daa00/0x7a8dd0fcbb924d35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0d2 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438305.720288:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438305.720368:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d055e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58dec870-790c-4419-a02f-595f69c3b298+14:2353:x1876361749827456:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 159us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438305.722907:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438305.722963:0:11995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749828096 00000100:00100000:3.0:1789438305.722974:0:11995:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749828096 00000100:00100000:3.0:1789438305.723064:0:11995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 72 00000100:00100000:3.0:1789438305.723077:0:11995:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1274be99-2d57-4dac-a13e-a89426512ee0+7:2352:x1876361749828096:12345-192.168.206.9@tcp:9:umount.0 00000020:00000080:3.0:1789438305.723133:0:11995:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb925275 00000020:00010000:3.0:1789438305.723143:0:11995:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9991e1e96800: total 0 00000100:00080000:3.0:1789438305.723149:0:11995:0:(import.c:65:import_set_state_nolock()) ffff9991e1e96000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789438305.723211:0:11995:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1789438305.723505:0:11995:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1274be99-2d57-4dac-a13e-a89426512ee0+5:2352:x1876361749828096:12345-192.168.206.9@tcp:9:umount.0 Request processed in 430us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438305.723513:0:11995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 72 00000020:00010000:3.0:1789438305.723548:0:5825:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9991e1e96800: total 0 00010000:00010000:3.0:1789438305.723570:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9991e1e96800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1789438305.723634:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e473c913/0x7a8dd0fcbb925ca1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa539 expref: 4 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438305.723672:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb3a785b/0x7a8dd0fcbb925611 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa372 expref: 3 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438305.723687:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9991e1e96800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1789438305.723746:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438305.723748:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438305.723750:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789438305.723759:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789438305.724914:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 19 00000100:00100000:2.0:1789438305.724946:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58dec870-790c-4419-a02f-595f69c3b298+14:2353:x1876361749827712:12345-192.168.206.9@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789438305.724951:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 18 00010000:00010000:2.0:1789438305.724971:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438305.724997:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991f3d62e00/0x7a8dd0fcbb924f49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa19d expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438305.725014:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438305.725038:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 20 00000100:00100000:0.0:1789438305.725049:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58dec870-790c-4419-a02f-595f69c3b298+12:2353:x1876361749827584:12345-192.168.206.9@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789438305.725090:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58dec870-790c-4419-a02f-595f69c3b298+12:2353:x1876361749827712:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 162us (5533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438305.725099:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 19 00010000:00010000:0.0:1789438305.725247:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438305.725273:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991ff9dbc00/0x7a8dd0fcbb924c9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa09a expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438305.725284:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438305.725303:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58dec870-790c-4419-a02f-595f69c3b298+10:2353:x1876361749827584:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 258us (5708us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438305.725310:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 20 00000100:00100000:3.0:1789438305.735893:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438305.736063:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749828224 00000100:00100000:1.0:1789438305.736075:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749828224 00000100:00100000:1.0:1789438305.736162:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 73 00000100:00100000:1.0:1789438305.736174:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+5:2352:x1876361749828224:12345-192.168.206.9@tcp:9:umount.0 00000020:00000080:1.0:1789438305.736212:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb92500d 00000100:00080000:1.0:1789438305.736222:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9991c7de4800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1789438305.736509:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:1.0:1789438305.736584:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1789438305.736967:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1274be99-2d57-4dac-a13e-a89426512ee0+2:2352:x1876361749828224:12345-192.168.206.9@tcp:9:umount.0 Request processed in 793us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438305.736994:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 73 00010000:00010000:0.0:1789438305.742678:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438305.753233:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438305.753347:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749829248 00000100:00100000:2.0:1789438305.753360:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749829248 00000100:00100000:2.0:1789438305.753437:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 239 00000100:00100000:2.0:1789438305.753449:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+22:2352:x1876361749829248:12345-192.168.206.9@tcp:39:umount.0 00000020:00000080:2.0:1789438305.753496:0:7624:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924ca9 00000020:00010000:2.0:1789438305.753527:0:7624:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9990c2516000: total 0 00000100:00080000:2.0:1789438305.753534:0:7624:0:(import.c:65:import_set_state_nolock()) ffff9990c1cc1000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789438305.753569:0:7624:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:1.0:1789438305.753910:0:11648:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9990c2516000: total 0 00010000:00010000:1.0:1789438305.753980:0:11648:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9990c2516000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789438305.754022:0:11648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991c3ac2000) 00010000:00010000:1.0:1789438305.754027:0:11648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789438305.754038:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62600/0x7a8dd0fcbb9255fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa36b expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438305.754059:0:11648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991c3ac2000) 00010000:00010000:1.0:1789438305.754061:0:11648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789438305.754066:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0e00/0x7a8dd0fcbb9255d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa35d expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438305.754080:0:11648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:1.0:1789438305.754082:0:11648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789438305.754086:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0400/0x7a8dd0fcbb925665 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa387 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438305.754100:0:11648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:1.0:1789438305.754103:0:11648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789438305.754107:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1600/0x7a8dd0fcbb9252d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa299 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438305.754120:0:11648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9991c7c83100) 00010000:00010000:1.0:1789438305.754123:0:11648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789438305.754127:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db200/0x7a8dd0fcbb924f73 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1ab expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438305.754175:0:11648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:1.0:1789438305.754178:0:11648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789438305.754182:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55200/0x7a8dd0fcbb925c62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa524 expref: 16 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438305.754197:0:11648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:1.0:1789438305.754199:0:11648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789438305.754202:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63400/0x7a8dd0fcbb925c8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa532 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438305.754215:0:11648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9991c3ac2000) 00010000:00010000:1.0:1789438305.754217:0:11648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789438305.754221:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb9254f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa325 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438305.754238:0:11648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9991d5872100) 00010000:00010000:1.0:1789438305.754240:0:11648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789438305.754255:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f1a00/0x7a8dd0fcbb924fe3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1c7 expref: 13 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438305.754273:0:11648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9991c7c83900) 00010000:00010000:1.0:1789438305.754275:0:11648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789438305.754279:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9da200/0x7a8dd0fcbb925b82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa4ec expref: 12 pid: 12507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438305.754293:0:11648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:1.0:1789438305.754296:0:11648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789438305.754307:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55400/0x7a8dd0fcbb925681 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa38e expref: 11 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438305.754321:0:11648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9991d5872000) 00010000:00010000:1.0:1789438305.754323:0:11648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438305.754326:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e74f0c00/0x7a8dd0fcbb924f8f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa1b2 expref: 10 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438305.754339:0:11648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9991d192c900) 00010000:00010000:1.0:1789438305.754341:0:11648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789438305.754345:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991ff9db400/0x7a8dd0fcbb925960 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa460 expref: 9 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438305.754358:0:11648:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9990c2516000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1789438305.754372:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438305.754374:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438305.754377:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438305.756695:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1274be99-2d57-4dac-a13e-a89426512ee0+7:2352:x1876361749829248:12345-192.168.206.9@tcp:39:umount.0 Request processed in 3236us (3629us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1789438305.756943:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 239 00010000:00010000:3.0:1789438306.167005:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438306.775230:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438306.775290:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438306.776005:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749829376 00000100:00100000:1.0:1789438306.776016:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749829376 00000100:00100000:1.0:1789438306.776079:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 297 00000100:00100000:1.0:1789438306.776090:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+10:2354:x1876361749829376:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438306.776166:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58dec870-790c-4419-a02f-595f69c3b298+10:2354:x1876361749829376:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 78us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438306.776173:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 297 00000100:00100000:2.0:1789438306.776291:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749829504 00000100:00100000:2.0:1789438306.776296:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749829504 00000100:00100000:2.0:1789438306.776349:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 165 00000100:00100000:2.0:1789438306.776357:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1969457-1646-49ba-87ff-a507cb42c3bf+6:2354:x1876361749829504:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789438306.776405:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1969457-1646-49ba-87ff-a507cb42c3bf+6:2354:x1876361749829504:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 48us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438306.776411:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 165 00000100:00080000:3.0:1789438306.776529:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1789438307.171327:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1274be99-2d57-4dac-a13e-a89426512ee0 00000020:00000080:0.0:1789438307.171337:0:7628:0:(genops.c:885:class_export_put()) final put ffff9991e1e96800/1274be99-2d57-4dac-a13e-a89426512ee0 00000020:00000080:3.0:1789438307.171720:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9991e1e96800/1274be99-2d57-4dac-a13e-a89426512ee0 for lustre-OST0001 00000020:00000080:3.0:1789438307.171777:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9991e1e96000 for lustre-OST0001 00000001:00080000:2.0:1789438307.185488:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:2.0:1789438307.185602:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1274be99-2d57-4dac-a13e-a89426512ee0 00000001:00080000:2.0:1789438307.185610:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1789438307.185617:0:5860:0:(genops.c:885:class_export_put()) final put ffff9990c2516000/1274be99-2d57-4dac-a13e-a89426512ee0 00000020:00000080:0.0:1789438307.185813:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9990c2516000/1274be99-2d57-4dac-a13e-a89426512ee0 for lustre-MDT0000 00000020:00000080:0.0:1789438307.186017:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9990c1cc1000 for lustre-MDT0000 00010000:00010000:0.0:1789438307.190840:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438307.353161:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438307.353206:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438307.353246:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438307.353412:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749829632 00000100:00100000:2.0:1789438307.353423:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749829632 00000100:00100000:2.0:1789438307.353490:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749829888 00000100:00100000:2.0:1789438307.353494:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749829888 00000100:00100000:2.0:1789438307.353507:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749829760 00000100:00100000:2.0:1789438307.353510:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749829760 00000100:00100000:2.0:1789438307.353526:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 21 00000100:00100000:2.0:1789438307.353534:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58dec870-790c-4419-a02f-595f69c3b298+12:2355:x1876361749829632:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789438307.353550:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438307.353569:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991ff9db600/0x7a8dd0fcbb924d7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0e7 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438307.353587:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789438307.353642:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58dec870-790c-4419-a02f-595f69c3b298+11:2355:x1876361749829632:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 108us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438307.353665:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 21 00000100:00100000:2.0:1789438307.353683:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 22 00000100:00100000:2.0:1789438307.353690:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58dec870-790c-4419-a02f-595f69c3b298+10:2355:x1876361749829888:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789438307.353698:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438307.353755:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991f3d62a00/0x7a8dd0fcbb924f42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa196 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438307.353765:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789438307.353786:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58dec870-790c-4419-a02f-595f69c3b298+9:2355:x1876361749829888:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 96us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438307.353791:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 22 00000100:00100000:2.0:1789438307.353804:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 23 00000100:00100000:2.0:1789438307.353810:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58dec870-790c-4419-a02f-595f69c3b298+8:2355:x1876361749829760:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789438307.353817:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438307.353826:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c2a55600/0x7a8dd0fcbb924d82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa111 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438307.353835:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789438307.353851:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58dec870-790c-4419-a02f-595f69c3b298+7:2355:x1876361749829760:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 41us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438307.353857:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 23 00000100:00100000:0.0:1789438307.366353:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438307.366507:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749830144 00000100:00100000:3.0:1789438307.366518:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749830144 00000100:00100000:3.0:1789438307.366585:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 240 00000100:00100000:3.0:1789438307.366596:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1969457-1646-49ba-87ff-a507cb42c3bf+6:2352:x1876361749830144:12345-192.168.206.9@tcp:39:umount.0 00000020:00000080:3.0:1789438307.366637:0:5840:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924d90 00000020:00010000:3.0:1789438307.366646:0:5840:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9990c2513800: total 0 00000100:00080000:3.0:1789438307.366651:0:5840:0:(import.c:65:import_set_state_nolock()) ffff9990c2511000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789438307.366683:0:5840:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:1.0:1789438307.366766:0:11648:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9990c2513800: total 0 00010000:00010000:1.0:1789438307.366771:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438307.366813:0:11648:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9990c2513800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789438307.366846:0:11648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:1.0:1789438307.366870:0:11648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789438307.366879:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63a00/0x7a8dd0fcbb925caf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa540 expref: 5 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438307.366904:0:11648:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9990c2513800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789438307.366916:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438307.366917:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438307.366919:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438307.367206:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1969457-1646-49ba-87ff-a507cb42c3bf+3:2352:x1876361749830144:12345-192.168.206.9@tcp:39:umount.0 Request processed in 612us (863us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1789438307.367215:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 240 00000100:00100000:2.0:1789438307.410061:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438307.410204:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749830400 00000100:00100000:0.0:1789438307.410215:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749830400 00000100:00100000:0.0:1789438307.410274:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 298 00000100:00100000:0.0:1789438307.410294:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+7:2352:x1876361749830400:12345-192.168.206.9@tcp:251:umount.0 00000020:00000080:0.0:1789438307.410344:0:5833:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924c86 00000020:00010000:0.0:1789438307.410353:0:5833:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9990c1268800: total 0 00000100:00080000:0.0:1789438307.410358:0:5833:0:(import.c:65:import_set_state_nolock()) ffff9990c126f000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789438307.410434:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58dec870-790c-4419-a02f-595f69c3b298+3:2352:x1876361749830400:12345-192.168.206.9@tcp:251:umount.0 Request processed in 151us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438307.410442:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 298 00000020:00010000:3.0:1789438307.410658:0:5825:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9990c1268800: total 0 00010000:00010000:3.0:1789438307.410698:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9990c1268800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789438307.410780:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c0030200/0x7a8dd0fcbb924d3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa0d9 expref: 2 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438307.410794:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9990c1268800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1789438307.410804:0:5825:0:(genops.c:885:class_export_put()) final put ffff9990c1268800/58dec870-790c-4419-a02f-595f69c3b298 00010000:00010000:3.0:1789438307.410813:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438307.410815:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438307.410817:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789438307.411546:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9990c1268800/58dec870-790c-4419-a02f-595f69c3b298 for MGS 00000020:00000080:0.0:1789438307.411590:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9990c126f000 for MGS 00000001:00100000:0.0:1789438308.192689:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1274be99-2d57-4dac-a13e-a89426512ee0 00000020:00000080:0.0:1789438308.192700:0:6706:0:(genops.c:885:class_export_put()) final put ffff9991c7de5000/1274be99-2d57-4dac-a13e-a89426512ee0 00000020:00000080:0.0:1789438308.192765:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9991c7de5000/1274be99-2d57-4dac-a13e-a89426512ee0 for lustre-OST0000 00000020:00000080:0.0:1789438308.192830:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9991c7de4800 for lustre-OST0000 00010000:00010000:0.0:1789438308.214994:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438309.238835:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789438309.374480:0:12999:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789438309.409827:0:12999:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1789438309.409880:0:12999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c0031200/0x7a8dd0fcbb924d0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924d12 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438309.409907:0:12999:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c0031200/0x7a8dd0fcbb924d0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924d12 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438309.409924:0:12999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c0031200/0x7a8dd0fcbb924d0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7a8dd0fcbb924d12 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438309.409932:0:12999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.109@tcp lock: ffff9991c0031200/0x7a8dd0fcbb924d0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7a8dd0fcbb924d12 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438309.409948:0:12999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789438309.409954:0:12999:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789438309.409974:0:12999:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789438309.409979:0:12999:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789438309.409985:0:12999:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789438309.410014:0:12999:0:(import.c:65:import_set_state_nolock()) ffff9991fbad2800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789438309.410086:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876361769730816:0@lo:39:umount.0 00000100:00100000:0.0:1789438309.410154:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789438309.410340:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789438309.410347:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991c0031200/0x7a8dd0fcbb924d0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x7a8dd0fcbb924d12 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438309.410355:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c0031200 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:1.0:1789438309.410358:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991c0031200/0x7a8dd0fcbb924d0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x7a8dd0fcbb924d12 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438309.410367:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991c0031200/0x7a8dd0fcbb924d0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x7a8dd0fcbb924d12 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789438309.410375:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991c0031200/0x7a8dd0fcbb924d0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x7a8dd0fcbb924d12 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789438309.410381:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789438309.410384:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789438309.410386:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789438309.410413:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991c0031200/0x7a8dd0fcbb924d0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7a8dd0fcbb924d12 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438309.410420:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789438309.410449:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991c0031200/0x7a8dd0fcbb924d0b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7a8dd0fcbb924d12 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438309.410473:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991c0031200/0x7a8dd0fcbb924d0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7a8dd0fcbb924d12 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438309.410486:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438309.410487:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438309.410489:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438309.410496:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789438309.410506:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769730944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789438309.410539:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438309.410667:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769730944 00000100:00100000:1.0:1789438309.410675:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769730944 00000100:00100000:1.0:1789438309.410746:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789438309.410755:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3311:x1876361769730944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789438309.410768:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438309.410783:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991ff9db800/0x7a8dd0fcbb924d12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7a8dd0fcbb924d0b expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438309.410795:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438309.410831:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7073a0da-08cf-42fe-8791-a8c6139408f2+18:3311:x1876361769730944:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438309.410839:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789438309.410878:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7073a0da-08cf-42fe-8791-a8c6139408f2:3311:1876361769730944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789438309.411025:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769730816 00000100:00100000:3.0:1789438309.411030:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769730816 00000100:00100000:3.0:1789438309.411066:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789438309.411081:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f47d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876361769730816:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789438309.411104:0:7624:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924a95 00000100:00080000:3.0:1789438309.411114:0:7624:0:(import.c:65:import_set_state_nolock()) ffff9991fbad1000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789438309.411174:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f47d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3308:x1876361769730816:12345-0@lo:39:umount.0 Request processed in 94us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438309.411181:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:3.0:1789438309.411188:0:7624:0:(genops.c:885:class_export_put()) final put ffff9991fbad7000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1789438309.411210:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9991fbad7000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789438309.411255:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9991fbad1000 for lustre-MDT0000 00010000:00010000:0.0:1789438309.411431:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789438309.411457:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9991fbad2800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789438309.411476:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876361769730816:0@lo:39:umount.0 00000100:00080000:3.0:1789438309.411678:0:12999:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789438309.411681:0:12999:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789438309.411685:0:12999:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789438309.414105:0:12999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9da400/0x7a8dd0fcbb924d19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924d20 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438309.414124:0:12999:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9da400/0x7a8dd0fcbb924d19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924d20 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438309.414131:0:12999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9da400/0x7a8dd0fcbb924d19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x7a8dd0fcbb924d20 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438309.414139:0:12999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.109@tcp lock: ffff9991ff9da400/0x7a8dd0fcbb924d19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x7a8dd0fcbb924d20 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438309.414202:0:12999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789438309.414211:0:12999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c0030c00/0x7a8dd0fcbb924c40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924c47 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438309.414218:0:12999:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c0030c00/0x7a8dd0fcbb924c40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924c47 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438309.414237:0:12999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c0030c00/0x7a8dd0fcbb924c40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7a8dd0fcbb924c47 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438309.414243:0:12999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.109@tcp lock: ffff9991c0030c00/0x7a8dd0fcbb924c40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7a8dd0fcbb924c47 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438309.415854:0:11648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789438309.415867:0:11648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991ff9da400/0x7a8dd0fcbb924d19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x7a8dd0fcbb924d20 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438309.415878:0:11648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9da400 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:0.0:1789438309.416799:0:11648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991ff9da400/0x7a8dd0fcbb924d19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x7a8dd0fcbb924d20 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438309.416815:0:11648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991ff9da400/0x7a8dd0fcbb924d19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x7a8dd0fcbb924d20 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789438309.416823:0:11648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991ff9da400/0x7a8dd0fcbb924d19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x7a8dd0fcbb924d20 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789438309.416829:0:11648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789438309.416832:0:11648:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1789438309.416875:0:11648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991ff9da400/0x7a8dd0fcbb924d19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7a8dd0fcbb924d20 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438309.416962:0:11648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789438309.417039:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769731072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789438309.417132:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789438309.417211:0:11648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991ff9da400/0x7a8dd0fcbb924d19 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7a8dd0fcbb924d20 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438309.417219:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991ff9da400/0x7a8dd0fcbb924d19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7a8dd0fcbb924d20 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438309.417233:0:11648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789438309.417238:0:11648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991c0030c00/0x7a8dd0fcbb924c40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7a8dd0fcbb924c47 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438309.417244:0:11648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c0030c00 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:0.0:1789438309.417247:0:11648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991c0030c00/0x7a8dd0fcbb924c40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7a8dd0fcbb924c47 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438309.417254:0:11648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991c0030c00/0x7a8dd0fcbb924c40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7a8dd0fcbb924c47 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789438309.417260:0:11648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991c0030c00/0x7a8dd0fcbb924c40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7a8dd0fcbb924c47 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789438309.417265:0:11648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789438309.417267:0:11648:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1789438309.417282:0:11648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991c0030c00/0x7a8dd0fcbb924c40 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7a8dd0fcbb924c47 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438309.417287:0:11648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789438309.418258:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769731072 00000100:00100000:2.0:1789438309.418268:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769731072 00000100:00100000:2.0:1789438309.418326:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789438309.418335:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d055d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7073a0da-08cf-42fe-8791-a8c6139408f2+18:3309:x1876361769731072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789438309.418362:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438309.418379:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff999202045c00/0x7a8dd0fcbb924d20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7a8dd0fcbb924d19 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438309.418395:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789438309.418554:0:12999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:3.0:1789438309.418574:0:12999:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789438309.418584:0:12999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991e74f0200/0x7a8dd0fcbb924f34 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924f3b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438309.418593:0:12999:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991e74f0200/0x7a8dd0fcbb924f34 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924f3b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438309.418600:0:12999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991e74f0200/0x7a8dd0fcbb924f34 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7a8dd0fcbb924f3b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438309.418606:0:12999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.109@tcp lock: ffff9991e74f0200/0x7a8dd0fcbb924f34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7a8dd0fcbb924f3b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438309.418622:0:12999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789438309.418627:0:12999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff999202044600/0x7a8dd0fcbb9249f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb9249fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438309.418633:0:12999:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff999202044600/0x7a8dd0fcbb9249f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb9249fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438309.418639:0:12999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff999202044600/0x7a8dd0fcbb9249f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7a8dd0fcbb9249fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438309.418656:0:12999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.109@tcp lock: ffff999202044600/0x7a8dd0fcbb9249f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7a8dd0fcbb9249fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438309.418663:0:12999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789438309.418666:0:12999:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1789438309.418669:0:12999:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1789438309.418695:0:12999:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1789438309.418700:0:12999:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1789438309.418705:0:12999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789438309.418725:0:12999:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:3.0:1789438309.418730:0:12999:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9991e071e800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789438309.418736:0:12999:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9991c80fb000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789438309.418743:0:12999:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9990c2513800 c1969457-1646-49ba-87ff-a507cb42c3bf 192.168.206.9@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789438309.418748:0:12999:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9991e1e519c0) has exports, disconnecting them 00000020:00080000:3.0:1789438309.418752:0:12999:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9991e071e800), last request at 1789438304 00000020:00000080:3.0:1789438309.418759:0:12999:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924c08 00000100:00080000:3.0:1789438309.418776:0:12999:0:(import.c:65:import_set_state_nolock()) ffff9991e0718000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789438309.418820:0:12999:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9991e071e800): rc 0 00000020:00000080:3.0:1789438309.418823:0:12999:0:(genops.c:885:class_export_put()) final put ffff9991e071e800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1789438309.418830:0:12999:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9991c80fb000), last request at 1789438304 00000020:00000080:3.0:1789438309.418833:0:12999:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924b3d 00000100:00080000:3.0:1789438309.418837:0:12999:0:(import.c:65:import_set_state_nolock()) ffff9991c80fe800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789438309.418844:0:12999:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9991c80fb000): rc 0 00000020:00000080:3.0:1789438309.418846:0:12999:0:(genops.c:885:class_export_put()) final put ffff9991c80fb000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1789438309.418854:0:12999:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaf4fc2cafae0 00000100:00080000:3.0:1789438309.418872:0:12999:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789438309.418876:0:12999:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1789438309.418905:0:12999:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789438309.418993:0:12999:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789438309.419012:0:12999:0:(import.c:65:import_set_state_nolock()) ffff9991eb24a000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789438309.419027:0:12999:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789438309.419030:0:12999:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1789438309.419038:0:12999:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789438309.419095:0:12999:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789438309.419103:0:12999:0:(import.c:65:import_set_state_nolock()) ffff9990c1268000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789438309.419131:0:12999:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9991e1e519c0) has no exports 00010000:00010000:0.0:1789438309.423632:0:11648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991c0030c00/0x7a8dd0fcbb924c40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7a8dd0fcbb924c47 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438309.423649:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991c0030c00/0x7a8dd0fcbb924c40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7a8dd0fcbb924c47 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438309.423698:0:11648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789438309.423703:0:11648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991e74f0200/0x7a8dd0fcbb924f34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7a8dd0fcbb924f3b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438309.423736:0:11648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f0200 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:0.0:1789438309.423740:0:11648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991e74f0200/0x7a8dd0fcbb924f34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7a8dd0fcbb924f3b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438309.423751:0:11648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991e74f0200/0x7a8dd0fcbb924f34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7a8dd0fcbb924f3b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789438309.423760:0:11648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991e74f0200/0x7a8dd0fcbb924f34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7a8dd0fcbb924f3b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789438309.423767:0:11648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789438309.423770:0:11648:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789438309.423773:0:11648:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789438309.423811:0:11648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991e74f0200/0x7a8dd0fcbb924f34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7a8dd0fcbb924f3b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438309.423819:0:11648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789438309.423849:0:11648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991e74f0200/0x7a8dd0fcbb924f34 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7a8dd0fcbb924f3b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438309.423856:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991e74f0200/0x7a8dd0fcbb924f34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7a8dd0fcbb924f3b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438309.423865:0:11648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789438309.423869:0:11648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff999202044600/0x7a8dd0fcbb9249f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7a8dd0fcbb9249fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438309.425023:0:11648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999202044600 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:0.0:1789438309.425031:0:11648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff999202044600/0x7a8dd0fcbb9249f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7a8dd0fcbb9249fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438309.425043:0:11648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff999202044600/0x7a8dd0fcbb9249f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7a8dd0fcbb9249fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789438309.425051:0:11648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff999202044600/0x7a8dd0fcbb9249f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7a8dd0fcbb9249fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789438309.425057:0:11648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789438309.425059:0:11648:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789438309.425062:0:11648:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789438309.425087:0:11648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff999202044600/0x7a8dd0fcbb9249f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7a8dd0fcbb9249fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438309.425093:0:11648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789438309.425105:0:11648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff999202044600/0x7a8dd0fcbb9249f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7a8dd0fcbb9249fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438309.425112:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff999202044600/0x7a8dd0fcbb9249f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7a8dd0fcbb9249fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438309.425128:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438309.425130:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438309.425132:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438309.425153:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769731200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789438309.425217:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438309.425279:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769731712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789438309.425312:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438309.425332:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789438309.425338:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769731584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789438309.425358:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438309.425388:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769731200 00000100:00100000:0.0:1789438309.425396:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769731200 00000100:00100000:0.0:1789438309.425432:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769731712 00000100:00100000:0.0:1789438309.425435:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769731712 00000100:00100000:0.0:1789438309.425446:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769731584 00000100:00100000:0.0:1789438309.425449:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769731584 00000100:00100000:0.0:1789438309.425463:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789438309.425471:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7073a0da-08cf-42fe-8791-a8c6139408f2+20:3310:x1876361769731200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789438309.425484:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438309.425499:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c2a54000/0x7a8dd0fcbb924c47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7a8dd0fcbb924c40 expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438309.425513:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438309.425549:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7073a0da-08cf-42fe-8791-a8c6139408f2+19:3310:x1876361769731200:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438309.425556:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789438309.425589:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789438309.425595:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7073a0da-08cf-42fe-8791-a8c6139408f2+18:3312:x1876361769731712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789438309.425603:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438309.425613:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991e0967600/0x7a8dd0fcbb9249fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7a8dd0fcbb9249f4 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438309.425624:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438309.425648:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7073a0da-08cf-42fe-8791-a8c6139408f2+17:3312:x1876361769731712:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438309.425659:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789438309.425673:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789438309.425679:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7073a0da-08cf-42fe-8791-a8c6139408f2+16:3312:x1876361769731584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789438309.425685:0:8438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438309.425694:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991e74f1200/0x7a8dd0fcbb924f3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7a8dd0fcbb924f34 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438309.425701:0:8438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438309.425757:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7073a0da-08cf-42fe-8791-a8c6139408f2+15:3312:x1876361769731584:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438309.425763:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789438309.425795:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769731200:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1789438309.425830:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9991e071e800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789438309.425871:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9991c80fb000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789438309.426077:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9991e0718000 for lustre-MDT0000 00000020:00000080:0.0:1789438309.426082:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9991c80fe800 for lustre-MDT0000 00010000:00010000:0.0:1789438309.426097:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438309.426116:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769731584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789438309.426124:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769731712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789438309.426148:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876361769731328:0@lo:9:umount.0 00000100:00100000:0.0:1789438309.426179:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438309.426203:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876361769731456:0@lo:9:umount.0 00000100:00100000:0.0:1789438309.426224:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438309.426253:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769731328 00000100:00100000:0.0:1789438309.426265:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769731328 00000100:00100000:0.0:1789438309.426303:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769731456 00000100:00100000:0.0:1789438309.426307:0:8192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769731456 00000100:00100000:0.0:1789438309.426328:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789438309.426334:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876361769731328:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789438309.426352:0:8192:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924b8a 00000100:00080000:0.0:1789438309.426361:0:8192:0:(import.c:65:import_set_state_nolock()) ffff9991eb24f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789438309.426387:0:8192:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1789438309.426975:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3308:x1876361769731328:12345-0@lo:9:umount.0 Request processed in 640us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438309.426983:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789438309.426998:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789438309.427005:0:8192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876361769731456:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789438309.427017:0:8192:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924c71 00000100:00080000:0.0:1789438309.427023:0:8192:0:(import.c:65:import_set_state_nolock()) ffff9991f440f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789438309.427042:0:8192:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1789438309.427228:0:8192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3308:x1876361769731456:12345-0@lo:9:umount.0 Request processed in 223us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438309.427234:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1789438309.427256:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789438309.427259:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789438309.427272:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789438309.427295:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9991eb24a000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789438309.427307:0:3308:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789438309.427310:0:3308:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789438309.427313:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876361769731328:0@lo:9:umount.0 00000100:00080000:0.0:1789438309.427323:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9990c1268000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789438309.427326:0:3308:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789438309.427336:0:3308:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789438309.427339:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876361769731456:0@lo:9:umount.0 00010000:00010000:0.0:1789438309.427364:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438309.429727:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438309.431485:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d055d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7073a0da-08cf-42fe-8791-a8c6139408f2+14:3309:x1876361769731072:12345-0@lo:103:ldlm_bl.0 Request processed in 13145us (14346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438309.431500:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789438309.432789:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769731072:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1789438309.443860:0:12999:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9991e1e519c0) has no exports 00000020:00000080:3.0:1789438309.527536:0:12999:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924a4f 00000020:00000080:3.0:1789438309.527553:0:12999:0:(genops.c:885:class_export_put()) final put ffff9991c6def000/lustre-QMT0000_UUID 00000020:01000000:3.0:1789438309.527574:0:12999:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1789438309.527606:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9991c6def000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789438309.527666:0:12999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789438309.527676:0:12999:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789438309.527680:0:12999:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9991f11d4d40) has no exports 00000020:00000080:2.0:1789438309.528688:0:12999:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924a48 00000020:00000080:2.0:1789438309.528697:0:12999:0:(genops.c:885:class_export_put()) final put ffff9991fbac0000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789438309.528749:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9991fbac0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789438309.528776:0:12999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789438309.528785:0:12999:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789438309.528789:0:12999:0:(genops.c:885:class_export_put()) final put ffff9991fbac5000/lustre-QMT0000_UUID 00000020:00000080:2.0:1789438309.528791:0:12999:0:(genops.c:844:class_export_destroy()) destroying export ffff9991fbac5000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789438309.528800:0:12999:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:1.0:1789438309.687200:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769731840:0@lo:400:kworker.0 00000100:00100000:1.0:1789438309.687270:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438309.687344:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789438309.687350:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876361769731968:0@lo:400:kworker.0 00000100:00100000:1.0:1789438309.687370:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438309.687446:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769731840 00000100:00100000:3.0:1789438309.687455:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769731840 00000100:00100000:3.0:1789438309.687499:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789438309.687508:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1876361769731840:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789438309.687516:0:5839:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789438309.687557:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1876361769731840:12345-0@lo:400:kworker.0 Request processed in 49us (286us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789438309.687563:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789438309.687580:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769731968 00000100:00100000:3.0:1789438309.687583:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769731968 00000100:00100000:3.0:1789438309.687602:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789438309.687606:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1876361769731968:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789438309.687611:0:5839:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789438309.687631:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1876361769731968:12345-0@lo:400:kworker.0 Request processed in 23us (260us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789438309.687636:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:1.0:1789438309.687751:0:3309:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789438309.687756:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9990c2511800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789438309.687760:0:3309:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789438309.695212:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9990c2511800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789438309.695226:0:3309:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 182 00000100:00080000:1.0:1789438309.695242:0:3309:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9990c2511800 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:1.0:1789438309.695281:0:3309:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9991faab5c00 x1876361769732096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789438309.695315:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876361769731968:0@lo:400:kworker.0 00000100:00080000:1.0:1789438309.695348:0:3309:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789438309.695352:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9991de19f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789438309.695355:0:3309:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789438309.695358:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9991de19f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789438309.695361:0:3309:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 165 00000100:00080000:1.0:1789438309.695365:0:3309:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9991de19f000 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:1.0:1789438309.695377:0:3309:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9991faab5180 x1876361769732224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789438309.695388:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769731840:0@lo:400:kworker.0 00000100:00100000:0.0:1789438309.695508:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1876361769732096:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1789438309.695568:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438309.695618:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1876361769732224:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1789438309.695638:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438309.695847:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769732096 00000100:00100000:3.0:1789438309.695856:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769732096 00000100:00100000:3.0:1789438309.696028:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769732224 00000100:00100000:3.0:1789438309.696032:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769732224 00000100:00100000:3.0:1789438309.696061:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789438309.696069:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff93b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3308:x1876361769732096:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1789438309.696084:0:5839:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789438309.696939:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789438309.696947:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3308:x1876361769732224:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1789438309.696960:0:7624:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789438309.697030:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3308:x1876361769732224:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 82us (1390us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789438309.697037:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:0.0:1789438309.697080:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9991de19f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789438309.697085:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789438309.697089:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1876361769732224:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1789438309.709383:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff93b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3308:x1876361769732096:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 13306us (13806us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789438309.709399:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:1.0:1789438309.710017:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9990c2511800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789438309.710025:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789438309.710030:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1876361769732096:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:0.0:1789438310.263827:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438311.286868:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438312.311019:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789438312.322139:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789438312.322148:0:7628:0:(genops.c:885:class_export_put()) final put ffff9991f440e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789438312.322242:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9991f440e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789438312.322283:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9991f440f000 for lustre-OST0001 00000001:00100000:2.0:1789438312.324315:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c1969457-1646-49ba-87ff-a507cb42c3bf 00000001:00080000:2.0:1789438312.324332:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1789438312.324337:0:5860:0:(genops.c:885:class_export_put()) final put ffff9990c2513800/c1969457-1646-49ba-87ff-a507cb42c3bf 00000020:00000080:0.0:1789438312.325619:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9990c2513800/c1969457-1646-49ba-87ff-a507cb42c3bf for lustre-MDT0000 00000020:00000080:0.0:1789438312.325690:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9990c2511000 for lustre-MDT0000 00010000:00010000:0.0:1789438313.336416:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789438313.345113:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789438313.345123:0:6706:0:(genops.c:885:class_export_put()) final put ffff9991eb248000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789438313.345158:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9991eb248000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789438313.345209:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9991eb24f000 for lustre-OST0000 00010000:00010000:0.0:1789438314.358870:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789438314.807242:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789438314.807249:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789438314.807253:0:8:0:(import.c:65:import_set_state_nolock()) ffff9991de19f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789438314.807276:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 361 00000100:00080000:2.0:1789438314.807284:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789438314.807296:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9991de19f000 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:2.0:1789438314.807321:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9991f3d2ea00 x1876361769732480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789438314.807397:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1876361769732480:0@lo:38:kworker.0 00000100:00100000:1.0:1789438314.807467:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789438314.807570:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789438314.807574:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789438314.807576:0:8:0:(import.c:65:import_set_state_nolock()) ffff9990c2511800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789438314.807580:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 361 00000100:00080000:2.0:1789438314.807583:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789438314.807591:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9990c2511800 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:2.0:1789438314.807606:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9991f3d2f480 x1876361769732608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789438314.807670:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789438314.807685:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769732352:0@lo:400:kworker.0 00000100:00100000:3.0:1789438314.807747:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438314.807790:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769732352 00000100:00100000:3.0:1789438314.807799:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769732352 00000100:00100000:3.0:1789438314.807858:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1789438314.807868:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e1f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+14:3312:x1876361769732352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438314.808901:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e1f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7073a0da-08cf-42fe-8791-a8c6139408f2+14:3312:x1876361769732352:12345-0@lo:400:kworker.0 Request processed in 1018us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438314.808912:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1789438314.808981:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769732352:0@lo:400:kworker.0 00000100:00100000:0.0:1789438314.810205:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769732480 00000100:00100000:0.0:1789438314.810217:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769732480 00000100:00100000:0.0:1789438314.810272:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789438314.810280:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1876361769732480:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1789438314.810298:0:5840:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789438314.811750:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1876361769732608:0@lo:38:kworker.0 00000100:00100000:1.0:1789438314.811832:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438314.812328:0:12507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769732608 00000100:00100000:2.0:1789438314.812337:0:12507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769732608 00000100:00100000:2.0:1789438314.812374:0:12507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1789438314.812381:0:12507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3308:x1876361769732608:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1789438314.812397:0:12507:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789438314.812444:0:12507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3308:x1876361769732608:12345-0@lo:38:kworker.0 Request processed in 62us (611us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789438314.812451:0:12507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:1.0:1789438314.812547:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9990c2511800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789438314.812552:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789438314.812556:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1876361769732608:0@lo:38:kworker.0 00000100:00100000:0.0:1789438314.819948:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1876361769732480:12345-0@lo:38:kworker.0 Request processed in 9659us (12472us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789438314.819964:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:1.0:1789438314.820423:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9991de19f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789438314.820430:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789438314.820434:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1876361769732480:0@lo:38:kworker.0 00010000:00010000:0.0:1789438315.383173:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789438315.574861:0:12999:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9990c3ad4de0 - data ffff9991ffd10948/ffff9990c1cad000 00000020:01000000:2.0:1789438315.575015:0:12999:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9991e5013d20 - data ffff9991eb633798/ffff9991e51c1000 00000001:00000004:2.0:1789438315.581171:0:12999:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1789438315.660131:0:12999:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789438315.660140:0:12999:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1789438315.660163:0:12999:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789438315.660166:0:12999:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789438315.662565:0:6824:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789438315.662573:0:6824:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1789438315.662590:0:6824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789438315.665202:0:12999:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789438315.665210:0:12999:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1789438315.665223:0:12999:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789438315.665226:0:12999:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789438315.667629:0:8101:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789438315.667637:0:8101:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1789438315.667652:0:8101:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1789438315.756696:0:12999:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924a17 00000020:00000080:2.0:1789438315.756873:0:12999:0:(genops.c:885:class_export_put()) final put ffff9991fae0b000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789438315.757638:0:12999:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924a2c 00000020:00000080:1.0:1789438315.757646:0:12999:0:(genops.c:885:class_export_put()) final put ffff9991fae09000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789438315.757678:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9991fae0b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789438315.757818:0:12999:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789438315.757828:0:12999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789438315.757837:0:12999:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789438315.757842:0:12999:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9991e1e53380) has no exports 00000004:01000000:1.0:1789438315.757995:0:12999:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789438315.758005:0:12999:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924c6a 00000020:00000080:1.0:1789438315.758019:0:12999:0:(genops.c:885:class_export_put()) final put ffff9990c1cc2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789438315.758095:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9991fae09000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789438315.758145:0:12999:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789438315.758149:0:12999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789438315.758155:0:12999:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789438315.758157:0:12999:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9991fa9b0000) has no exports 00000020:00000080:1.0:1789438315.758163:0:12999:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924c63 00000020:00000080:1.0:1789438315.758167:0:12999:0:(genops.c:885:class_export_put()) final put ffff9990c126b000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789438315.758220:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9990c1cc2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1789438315.758639:0:12999:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789438315.758646:0:12999:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789438315.758651:0:12999:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1789438315.758657:0:12999:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789438315.758660:0:12999:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789438315.758783:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9990c126b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789438315.758958:0:12999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789438315.758966:0:12999:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789438315.759003:0:12999:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924b83 00000020:00000080:1.0:1789438315.759036:0:12999:0:(genops.c:885:class_export_put()) final put ffff9990c1269800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789438315.759053:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9990c1268000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789438315.759058:0:8:0:(genops.c:885:class_export_put()) final put ffff9991fa759000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789438315.759060:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9991fa759000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1789438315.759065:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789438315.759168:0:12999:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789438315.759172:0:12999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789438315.759176:0:12999:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789438315.759179:0:12999:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9991eb258000) has no exports 00000020:00000080:1.0:1789438315.759183:0:12999:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924b7c 00000020:00000080:1.0:1789438315.759186:0:12999:0:(genops.c:885:class_export_put()) final put ffff9991eb249000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789438315.759204:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9990c1269800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1789438315.759616:0:12999:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789438315.759620:0:12999:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789438315.759623:0:12999:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1789438315.759628:0:12999:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789438315.759629:0:12999:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789438315.759661:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9991eb249000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789438315.759800:0:12999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789438315.759806:0:12999:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789438315.759843:0:12999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789438315.759846:0:12999:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789438315.759849:0:12999:0:(genops.c:885:class_export_put()) final put ffff9991f3747800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789438315.759857:0:12999:0:(genops.c:844:class_export_destroy()) destroying export ffff9991f3747800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789438315.759861:0:12999:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789438315.760083:0:12999:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924a33 00000020:00000080:1.0:1789438315.760089:0:12999:0:(genops.c:885:class_export_put()) final put ffff9991fae0b800/lustre-MDD0000_UUID 00000020:00000080:3.0:1789438315.760116:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9991eb24a000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789438315.760123:0:8:0:(genops.c:885:class_export_put()) final put ffff9991ffa94800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789438315.760125:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9991ffa94800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1789438315.760129:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789438315.760251:0:12999:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789438315.760255:0:12999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789438315.760259:0:12999:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789438315.760263:0:12999:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9991fae1cd40) has no exports 00000020:00000080:1.0:1789438315.760289:0:12999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789438315.760292:0:12999:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1789438315.760296:0:12999:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924a3a 00000020:00000080:1.0:1789438315.760300:0:12999:0:(genops.c:885:class_export_put()) final put ffff9991fae0c800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789438315.760322:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9991fae0b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1789438315.760326:0:8:0:(genops.c:885:class_export_put()) final put ffff9991fae0c000/lustre-MDD0000_UUID 00000020:00000080:3.0:1789438315.760329:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9991fae0c000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1789438315.760333:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1789438315.760541:0:12999:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9991d197a000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1789438315.760545:0:12999:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9991d197a000 3 00000020:01000004:1.0:1789438315.760548:0:12999:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9991d197a000 from lustre-MDT0000 00000020:00000080:1.0:1789438315.760568:0:12999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789438315.760572:0:12999:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1789438315.760575:0:12999:0:(genops.c:885:class_export_put()) final put ffff9991fae0a800/lustre-MDT0000_UUID 00000020:00000080:1.0:1789438315.760577:0:12999:0:(genops.c:844:class_export_destroy()) destroying export ffff9991fae0a800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1789438315.760584:0:12999:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1789438315.760609:0:12999:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1789438315.760612:0:12999:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1789438315.760615:0:12999:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1789438315.760618:0:12999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789438315.760621:0:12999:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789438315.760627:0:12999:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9991c7e94800 7073a0da-08cf-42fe-8791-a8c6139408f2 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789438315.760633:0:12999:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9991e1e50000) has exports, disconnecting them 00000020:00080000:1.0:1789438315.760637:0:12999:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9991c7e94800), last request at 1789438095 00000020:00000080:1.0:1789438315.760651:0:12999:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb9249d8 00000020:00010000:1.0:1789438315.760655:0:12999:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9991c7e94800: total 1 00000100:00080000:1.0:1789438315.760659:0:12999:0:(import.c:65:import_set_state_nolock()) ffff9991c7e93800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789438315.760682:0:12999:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9991c7e94800): rc 0 00000020:00080000:1.0:1789438315.760692:0:12999:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9991e1e50000) has no exports 00000100:00100000:1.0:1789438315.760805:0:5832:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9991c6d77a00:5832] 1 exiting: rc = 0 00000020:00010000:2.0:1789438315.760907:0:5826:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9991c7e94800: total 1 00010000:00010000:2.0:1789438315.760934:0:5826:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9991c7e94800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1789438315.760961:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c0031e00/0x7a8dd0fcbb924cda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7a8dd0fcbb924cd3 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438315.760977:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c0031a00/0x7a8dd0fcbb924ce8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7a8dd0fcbb924ce1 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438315.760989:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c0030800/0x7a8dd0fcbb924d04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7a8dd0fcbb924cfd expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438315.761000:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c0030600/0x7a8dd0fcbb924cf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7a8dd0fcbb924cef expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438315.761011:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c2a55c00/0x7a8dd0fcbb924f2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7a8dd0fcbb924f26 expref: 5 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438315.761021:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991f3d62800/0x7a8dd0fcbb924f1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7a8dd0fcbb924f18 expref: 4 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438315.761034:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c0030e00/0x7a8dd0fcbb924d2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7a8dd0fcbb924d27 expref: 3 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438315.761044:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991e0966a00/0x7a8dd0fcbb924af0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7a8dd0fcbb924ae9 expref: 2 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438315.761063:0:5826:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9991c7e94800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1789438315.761075:0:5826:0:(genops.c:885:class_export_put()) final put ffff9991c7e94800/7073a0da-08cf-42fe-8791-a8c6139408f2 00000100:00100000:1.0:1789438315.761183:0:5831:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9991c685ac00:5831] 0 exiting: rc = 1 00000020:00000080:3.0:1789438315.761260:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9991fae0c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1789438315.761284:0:5833:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9991c6d76800:5833] 2 exiting: rc = 0 00000100:00100000:1.0:1789438315.761377:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761386:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761392:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761399:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761405:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761411:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761418:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761424:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761431:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761438:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761446:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761453:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761459:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761466:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761472:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761478:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761484:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761490:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761495:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761502:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761508:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761514:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761519:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761525:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761530:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761535:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761542:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761548:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761553:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761559:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761564:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761577:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761582:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761588:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761594:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761599:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761604:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761610:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761615:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761620:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761626:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761632:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761638:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761644:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761650:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761655:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761661:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761666:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761673:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761678:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761684:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761689:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761695:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761701:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761737:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761744:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761751:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761757:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761763:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761770:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761776:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761782:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761788:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.761794:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1789438315.762179:0:12999:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789438315.762183:0:12999:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:2.0:1789438315.762843:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438315.762846:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438315.762848:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789438315.763039:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9991c7e94800/7073a0da-08cf-42fe-8791-a8c6139408f2 for MGS 00000020:00000080:1.0:1789438315.763163:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9991c7e93800 for MGS 00000020:01000000:3.0:1789438315.763204:0:12999:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9991d0557480 - data ffff9991eb7ef288/ffff9991f4407400 00000020:01000000:3.0:1789438315.763374:0:12999:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9991e5193de0 - data ffff9991cf31c5e8/ffff9991e1ff1800 00000020:00000080:2.0:1789438315.764120:0:12999:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb9249bc 00000020:00000080:2.0:1789438315.764128:0:12999:0:(genops.c:885:class_export_put()) final put ffff9991de030000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789438315.764175:0:12999:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9991d197a000 from MGS, refs=2 00000020:01000004:2.0:1789438315.764178:0:12999:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9991d197a000 2 00000020:01000004:2.0:1789438315.764182:0:12999:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9991d197a000 from MGS 00000020:00000080:2.0:1789438315.764202:0:12999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789438315.764209:0:12999:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1789438315.764212:0:12999:0:(genops.c:885:class_export_put()) final put ffff9991de031800/MGS 00000020:00000080:2.0:1789438315.764215:0:12999:0:(genops.c:844:class_export_destroy()) destroying export ffff9991de031800/MGS for MGS 00000020:01000000:2.0:1789438315.764223:0:12999:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1789438315.764270:0:12999:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1789438315.764274:0:12999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789438315.764279:0:12999:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789438315.764285:0:12999:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9991fbad3000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789438315.764290:0:12999:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff9991f11d3380) has exports, disconnecting them 00000020:00080000:2.0:1789438315.764294:0:12999:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9991fbad3000), last request at 1789438096 00000020:00000080:2.0:1789438315.764298:0:12999:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924a87 00000020:00080000:2.0:1789438315.764308:0:12999:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9991fbad3000): rc 0 00000020:00000080:2.0:1789438315.764313:0:12999:0:(genops.c:885:class_export_put()) final put ffff9991fbad3000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789438315.764332:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9991de030000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1789438315.765140:0:12999:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1789438315.765147:0:12999:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789438315.765151:0:12999:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789438315.765158:0:12999:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789438315.765200:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9991fbad3000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789438315.765366:0:12999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789438315.765372:0:12999:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1789438315.765377:0:12999:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9991d197a000 1 00000020:00000080:3.0:1789438315.765381:0:12999:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb9249ae 00000020:00000080:3.0:1789438315.765387:0:12999:0:(genops.c:885:class_export_put()) final put ffff9991de037000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1789438315.765390:0:12999:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1789438315.765404:0:12999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789438315.765408:0:12999:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789438315.765411:0:12999:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9991f11d19c0) has no exports 00000020:00000080:1.0:1789438315.765470:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9991fbad2800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789438315.765476:0:8:0:(genops.c:885:class_export_put()) final put ffff9991fbad6800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789438315.765479:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9991fbad6800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1789438315.765483:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1789438315.765532:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9991de037000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789438315.775526:0:12999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789438315.775539:0:12999:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1789438315.775544:0:12999:0:(genops.c:885:class_export_put()) final put ffff9991d197b000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789438315.775549:0:12999:0:(genops.c:844:class_export_destroy()) destroying export ffff9991d197b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789438315.775556:0:12999:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1789438315.775680:0:12999:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9991d197d000 00000020:01000000:3.0:1789438315.775722:0:12999:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1789438315.775726:0:12999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789438315.775731:0:12999:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789438315.775735:0:12999:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9991f11d0000) has no exports 00000100:00100000:0.0:1789438315.777445:0:5840:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9991c7e3b400:5840] 2 exiting: rc = 0 00000100:00100000:3.0:1789438315.777759:0:5839:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9991d1ac1200:5839] 1 exiting: rc = 0 00000100:00100000:3.0:1789438315.777841:0:7624:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9991fa2ffe00:7624] 3 exiting: rc = 0 00000100:00100000:1.0:1789438315.779821:0:12507:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff9991faa57600:12507] 4 exiting: rc = 0 00000100:00100000:3.0:1789438315.784972:0:5838:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9991e50ea400:5838] 0 exiting: rc = 1 00000100:00100000:1.0:1789438315.785149:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785158:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785164:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785170:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785176:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785182:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785188:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785194:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785201:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785207:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785221:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785228:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785235:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785241:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785247:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785253:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785258:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785264:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785269:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785275:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785280:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785285:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785305:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785310:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785315:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785321:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785327:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785333:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785339:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785345:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785351:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785357:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785364:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785370:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785376:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785382:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785388:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785393:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785399:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785404:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785410:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785416:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785422:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785428:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785434:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785440:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785445:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785450:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785456:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785462:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785468:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785474:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785480:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785486:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785491:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785496:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785502:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785516:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785521:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785527:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785534:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785540:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785546:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.785552:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.789701:0:5842:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9991c7e8b600:5842] 1 exiting: rc = 0 00000100:00100000:3.0:1789438315.789934:0:5841:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9991c7e8a000:5841] 0 exiting: rc = 1 00000100:00100000:1.0:1789438315.790029:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790038:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790044:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790050:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790056:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790063:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790069:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790075:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790081:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790087:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790093:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790099:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790106:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790112:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790118:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790124:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790129:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790135:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790142:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790147:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790153:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790159:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790164:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790169:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790175:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790180:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790186:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790203:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790208:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790214:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790220:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790225:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790231:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790236:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790242:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790247:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790252:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790258:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790262:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790267:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790272:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790277:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790283:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790288:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790293:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790298:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790303:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790307:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790312:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790317:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790322:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790327:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790332:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790337:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790341:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790347:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790352:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790359:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790365:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790370:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790376:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790381:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790393:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.790399:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789438315.791136:0:5844:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9991c7e3ae00:5844] 1 exiting: rc = 0 00000100:00100000:1.0:1789438315.791236:0:5843:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9991c803b600:5843] 0 exiting: rc = 1 00000100:00100000:1.0:1789438315.791284:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791298:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791306:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791312:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791319:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791325:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791332:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791339:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791345:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791352:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791369:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791377:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791384:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791393:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791400:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791407:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791413:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791420:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791427:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791434:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791441:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791447:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791467:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791474:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791482:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791489:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791499:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791506:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791513:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791519:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791526:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791533:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791547:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791554:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791574:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791581:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791589:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791596:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791603:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791610:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791617:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791625:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791632:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791639:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791646:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791652:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791671:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791678:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791684:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791691:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791697:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791763:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791772:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791778:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791785:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791791:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791798:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791804:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791905:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791914:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791920:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791926:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791933:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.791946:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.800447:0:5846:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9991c7e8ba00:5846] 1 exiting: rc = 0 00000100:00100000:0.0:1789438315.800937:0:5845:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9991d19eaa00:5845] 0 exiting: rc = 1 00000100:00100000:1.0:1789438315.801195:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801203:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801219:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801224:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801231:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801237:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801243:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801249:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801255:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801261:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801266:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801272:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801278:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801283:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801289:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801295:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801300:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801306:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801311:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801317:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801322:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801327:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801333:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801338:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801343:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801348:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801354:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801359:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801364:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801369:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801375:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801380:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801386:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801391:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801399:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801405:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801411:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801423:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801429:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801434:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801440:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801446:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801452:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801457:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801462:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801467:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801473:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801478:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801483:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801488:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801494:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801499:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801504:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801509:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801514:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801519:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801524:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801529:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801533:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801538:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801543:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801548:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801554:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801559:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.801964:0:5847:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9991c7e8a400:5847] 0 exiting: rc = 1 00000100:00100000:1.0:1789438315.802033:0:5848:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9991d0457e00:5848] 1 exiting: rc = 0 00000100:00100000:1.0:1789438315.802075:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802081:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802085:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802090:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802095:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802100:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802113:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802118:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802123:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802128:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802133:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802138:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802142:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802147:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802152:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802157:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802161:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802166:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802171:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802175:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802180:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802184:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802189:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802194:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802198:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802203:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802208:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802213:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802218:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802222:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802227:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802231:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802236:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802241:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802247:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802252:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802256:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802261:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802266:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802271:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802276:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802291:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802297:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802302:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802307:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802311:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802316:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802320:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802325:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802329:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802334:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802338:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802343:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802348:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802353:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802358:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802362:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802366:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802371:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802376:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802380:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802385:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802389:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802394:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802733:0:5850:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9991d0457a00:5850] 1 exiting: rc = 0 00000100:00100000:1.0:1789438315.802786:0:5849:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9991d0456200:5849] 0 exiting: rc = 1 00000100:00100000:1.0:1789438315.802828:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802835:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802840:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802844:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802850:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802855:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802860:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802865:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802870:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802875:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802901:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802905:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802911:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802916:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802921:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802926:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802931:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802936:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802941:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802946:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802951:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802955:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802960:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802965:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802969:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802975:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802980:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802985:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802990:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.802996:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803001:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803007:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803012:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803017:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803022:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803028:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803033:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803038:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803044:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803048:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803053:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803058:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803063:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803068:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803073:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803085:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803091:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803096:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803101:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803106:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803112:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803116:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803121:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803125:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803131:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803136:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803141:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803146:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803151:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803156:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803160:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803165:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803170:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803174:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.803624:0:5851:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9991c7e36000:5851] 0 exiting: rc = 1 00000100:00100000:1.0:1789438315.803835:0:5852:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9991c7e37600:5852] 1 exiting: rc = 0 00000100:00100000:1.0:1789438315.804293:0:5853:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9991e1f50c00:5853] 2 exiting: rc = 0 00000100:00100000:1.0:1789438315.804349:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804356:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804363:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804368:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804374:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804380:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804386:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804391:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804397:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804404:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804410:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804416:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804422:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804437:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804443:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804449:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804469:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804476:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804482:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804488:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804494:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804499:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804505:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804512:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804518:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804524:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804530:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804536:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804542:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804548:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804555:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804561:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804567:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804573:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804579:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804586:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804592:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804599:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804605:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804611:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804617:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804623:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804629:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804637:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804642:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804649:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804662:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804669:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804692:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804700:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804723:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804730:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804736:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804742:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804748:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804753:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804760:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804765:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804771:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804777:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804784:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804789:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804796:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438315.804801:0:12999:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789438315.809738:0:12999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789438315.809750:0:12999:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1789438315.809756:0:12999:0:(genops.c:885:class_export_put()) final put ffff9991de19f800/MDS_uuid 00000020:00000080:1.0:1789438315.809760:0:12999:0:(genops.c:844:class_export_destroy()) destroying export ffff9991de19f800/MDS_uuid for MDS 00000020:01000000:1.0:1789438315.809766:0:12999:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1789438315.809924:0:12999:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1789438316.408799:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438317.431617:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438318.456625:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789438318.841906:0:13156:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789438318.853521:0:13156:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1789438318.853567:0:13156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9db000/0x7a8dd0fcbb924cef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924cf6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438318.853583:0:13156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9db000/0x7a8dd0fcbb924cef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924cf6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438318.853589:0:13156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9db000/0x7a8dd0fcbb924cef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x7a8dd0fcbb924cf6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438318.853612:0:13156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.109@tcp lock: ffff9991ff9db000/0x7a8dd0fcbb924cef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x7a8dd0fcbb924cf6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438318.853631:0:13156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789438318.853636:0:13156:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789438318.853656:0:13156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789438318.853661:0:13156:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789438318.853701:0:13156:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789438318.853724:0:13156:0:(import.c:65:import_set_state_nolock()) ffff9991de19f000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1789438318.853729:0:13156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789438318.853732:0:13156:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789438318.853736:0:13156:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789438318.854609:0:11648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789438318.854618:0:11648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991ff9db000/0x7a8dd0fcbb924cef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x7a8dd0fcbb924cf6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438318.854629:0:11648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9db000 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:0.0:1789438318.854633:0:11648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991ff9db000/0x7a8dd0fcbb924cef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x7a8dd0fcbb924cf6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438318.854644:0:11648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991ff9db000/0x7a8dd0fcbb924cef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x7a8dd0fcbb924cf6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789438318.854651:0:11648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991ff9db000/0x7a8dd0fcbb924cef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x7a8dd0fcbb924cf6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789438318.854657:0:11648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789438318.854659:0:11648:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789438318.854662:0:11648:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789438318.854700:0:11648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991ff9db000/0x7a8dd0fcbb924cef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x7a8dd0fcbb924cf6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438318.854739:0:11648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789438318.854766:0:11648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991ff9db000/0x7a8dd0fcbb924cef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x7a8dd0fcbb924cf6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438318.854773:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991ff9db000/0x7a8dd0fcbb924cef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x7a8dd0fcbb924cf6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438318.854786:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438318.854788:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438318.854789:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438318.854809:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769732736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789438318.854887:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438318.854957:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769732736 00000100:00100000:0.0:1789438318.854965:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769732736 00000100:00100000:0.0:1789438318.855002:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789438318.855010:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3312:x1876361769732736:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789438318.855016:0:5822:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789438318 with bad export cookie 8830944228240673240 00010000:00010000:1.0:1789438318.855780:0:13156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c0030000/0x7a8dd0fcbb924cfd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924d04 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438318.855792:0:13156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c0030000/0x7a8dd0fcbb924cfd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924d04 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438318.855799:0:13156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c0030000/0x7a8dd0fcbb924cfd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7a8dd0fcbb924d04 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438318.855806:0:13156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.109@tcp lock: ffff9991c0030000/0x7a8dd0fcbb924cfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7a8dd0fcbb924d04 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438318.855824:0:13156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789438318.855838:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789438318.855842:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991c0030000/0x7a8dd0fcbb924cfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7a8dd0fcbb924d04 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438318.855861:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c0030000 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:1.0:1789438318.855875:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991c0030000/0x7a8dd0fcbb924cfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7a8dd0fcbb924d04 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438318.855883:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991c0030000/0x7a8dd0fcbb924cfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x7a8dd0fcbb924d04 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789438318.855889:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991c0030000/0x7a8dd0fcbb924cfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x7a8dd0fcbb924d04 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789438318.855904:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789438318.855906:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1789438318.855926:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991c0030000/0x7a8dd0fcbb924cfd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7a8dd0fcbb924d04 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438318.855932:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789438318.855958:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991c0030000/0x7a8dd0fcbb924cfd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7a8dd0fcbb924d04 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438318.855964:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991c0030000/0x7a8dd0fcbb924cfd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7a8dd0fcbb924d04 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438318.855976:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438318.855978:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438318.855979:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438318.855993:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769732864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789438318.856033:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789438318.856073:0:13156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991f3d62400/0x7a8dd0fcbb924f26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924f2d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438318.856092:0:13156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991f3d62400/0x7a8dd0fcbb924f26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924f2d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438318.856099:0:13156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991f3d62400/0x7a8dd0fcbb924f26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7a8dd0fcbb924f2d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438318.856106:0:13156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.109@tcp lock: ffff9991f3d62400/0x7a8dd0fcbb924f26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7a8dd0fcbb924f2d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438318.856119:0:13156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789438318.856123:0:13156:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1789438318.856128:0:13156:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1789438318.856146:0:13156:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1789438318.856150:0:13156:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1789438318.856155:0:13156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789438318.856161:0:13156:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789438318.856166:0:13156:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9991fae18000) has no exports 00000020:00080000:1.0:1789438318.856187:0:13156:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9991fae18000) has no exports 00000100:00100000:2.0:1789438318.856389:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769732864 00000100:00100000:2.0:1789438318.856395:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769732864 00000100:00100000:2.0:1789438318.856425:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789438318.856437:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3309:x1876361769732864:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789438318.856443:0:5824:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789438318 with bad export cookie 8830944228240673240 00000100:00100000:2.0:1789438318.856491:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3309:x1876361769732864:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (457us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789438318.856498:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1789438318.856519:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789438318.856523:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991f3d62400/0x7a8dd0fcbb924f26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7a8dd0fcbb924f2d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438318.856529:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d62400 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:2.0:1789438318.856532:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991f3d62400/0x7a8dd0fcbb924f26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7a8dd0fcbb924f2d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438318.856539:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991f3d62400/0x7a8dd0fcbb924f26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7a8dd0fcbb924f2d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789438318.856546:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991f3d62400/0x7a8dd0fcbb924f26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7a8dd0fcbb924f2d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789438318.856551:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789438318.856553:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789438318.856555:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789438318.856569:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991f3d62400/0x7a8dd0fcbb924f26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7a8dd0fcbb924f2d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438318.856576:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789438318.856587:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991f3d62400/0x7a8dd0fcbb924f26 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7a8dd0fcbb924f2d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438318.856593:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991f3d62400/0x7a8dd0fcbb924f26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7a8dd0fcbb924f2d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438318.856609:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438318.856610:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438318.856612:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438318.856626:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769732992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789438318.856653:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438318.856676:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769732992 00000100:00100000:2.0:1789438318.856679:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769732992 00000100:00100000:2.0:1789438318.856696:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789438318.856700:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3310:x1876361769732992:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789438318.856704:0:5824:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789438318 with bad export cookie 8830944228240673240 00000100:00100000:2.0:1789438318.856749:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3310:x1876361769732992:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (96us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789438318.856755:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1789438318.856785:0:3310:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.109@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789438318.856790:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9991de033000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789438318.856794:0:3310:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.109@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:01000000:1.0:1789438318.862686:0:13156:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9990c3ad48a0 - data ffff9991ffd10a20/ffff9990c1cad400 00000020:01000000:1.0:1789438318.862862:0:13156:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9991e50e1840 - data ffff9991cf3e10d8/ffff9991fbb2ec00 00000100:00080000:3.0:1789438318.868535:0:3309:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.109@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1789438318.895924:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3312:x1876361769732736:12345-0@lo:103:ldlm_bl.0 Request processed in 40902us (41025us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789438318.895940:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1789438318.896370:0:3312:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.109@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789438318.916447:0:3310:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.109@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789438318.916453:0:3310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789438318.916464:0:3310:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9991ff939180 x1876361769732736/t0(0) o103->MGC192.168.206.109@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789438334 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438318.916479:0:3310:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9991faab4e00 x1876361769732864/t0(0) o103->MGC192.168.206.109@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789438334 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438318.916489:0:3310:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9991f3d2c700 x1876361769732992/t0(0) o103->MGC192.168.206.109@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789438334 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789438318.916497:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789438318.916514:0:3310:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789438318.916515:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789438318.917062:0:3309:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9991de033000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1789438318.917084:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7073a0da-08cf-42fe-8791-a8c6139408f2:3309:1876361769732864:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1789438318.917134:0:3312:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9991de033000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1789438318.917306:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7073a0da-08cf-42fe-8791-a8c6139408f2:3312:1876361769732736:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789438318.917883:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9991de033000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789438318.917890:0:3310:0:(import.c:545:import_select_connection()) MGC192.168.206.109@tcp: connect to NID 0@lo last attempt 147 00000100:00080000:2.0:1789438318.917906:0:3310:0:(import.c:666:import_select_connection()) MGC192.168.206.109@tcp: import ffff9991de033000 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:0.0:1789438318.918115:0:3310:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9991ff939180 x1876361769733120/t0(0) o250->MGC192.168.206.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789438318.918590:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7073a0da-08cf-42fe-8791-a8c6139408f2:3308:1876361769733120:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:1.0:1789438318.918645:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876361769733120 offset 0 length 520: 4 00000100:00100000:0.0:1789438318.918730:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7073a0da-08cf-42fe-8791-a8c6139408f2:3310:1876361769732992:0@lo:103:ldlm_bl.0 00100000:10000000:0.0:1789438318.928943:0:13156:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789438318.963368:0:13156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924b0c 00000020:00000080:1.0:1789438318.963378:0:13156:0:(genops.c:885:class_export_put()) final put ffff9991ffaff000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1789438318.963431:0:13156:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9991d08f6800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1789438318.963434:0:13156:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9991d08f6800 2 00000020:01000004:1.0:1789438318.963437:0:13156:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9991d08f6800 from lustre-OST0000 00000020:00000080:1.0:1789438318.963457:0:13156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789438318.963479:0:13156:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1789438318.963483:0:13156:0:(genops.c:885:class_export_put()) final put ffff9991ffafb800/lustre-OST0000_UUID 00000020:00000080:1.0:1789438318.963485:0:13156:0:(genops.c:844:class_export_destroy()) destroying export ffff9991ffafb800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1789438318.963492:0:13156:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1789438318.963530:0:13156:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1789438318.963535:0:13156:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789438318.963538:0:13156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789438318.963543:0:13156:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789438318.963550:0:13156:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9991ffaf8800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789438318.963556:0:13156:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff9991ffba0000) has exports, disconnecting them 00000020:00080000:1.0:1789438318.963561:0:13156:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9991ffaf8800), last request at 1789438112 00000020:00000080:1.0:1789438318.963564:0:13156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924b36 00000020:00080000:1.0:1789438318.963574:0:13156:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9991ffaf8800): rc 0 00000020:00000080:1.0:1789438318.963578:0:13156:0:(genops.c:885:class_export_put()) final put ffff9991ffaf8800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789438318.963599:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9991ffaff000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789438318.964336:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9991ffaf8800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789438318.968066:0:13156:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789438318.968076:0:13156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789438318.968081:0:13156:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789438318.968089:0:13156:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789438318.968123:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9991de19f000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789438318.968702:0:13156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789438318.968729:0:13156:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1789438318.968734:0:13156:0:(genops.c:885:class_export_put()) final put ffff9991e071e000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1789438318.968738:0:13156:0:(genops.c:844:class_export_destroy()) destroying export ffff9991e071e000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1789438318.968750:0:13156:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1789438318.969205:0:13156:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9991d08f6800 1 00000020:00000080:0.0:1789438318.969212:0:13156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924ac6 00000020:00000080:0.0:1789438318.969218:0:13156:0:(genops.c:885:class_export_put()) final put ffff9991fae08000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789438318.969230:0:13156:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789438318.969241:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9991fae08000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789438318.969250:0:13156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789438318.969254:0:13156:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789438318.969258:0:13156:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9991fae1b380) has no exports 00000020:00000080:0.0:1789438318.993947:0:13156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789438318.993961:0:13156:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1789438318.993967:0:13156:0:(genops.c:885:class_export_put()) final put ffff9991d08f7000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789438318.993972:0:13156:0:(genops.c:844:class_export_destroy()) destroying export ffff9991d08f7000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1789438318.993981:0:13156:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1789438318.994118:0:13156:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9991d08f3000 00000020:02000400:0.0:1789438318.994162:0:13156:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789438319.479013:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789438319.938793:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7073a0da-08cf-42fe-8791-a8c6139408f2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789438319.938804:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7073a0da-08cf-42fe-8791-a8c6139408f2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789438319.938807:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789438319.938811:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789438319.938816:0:37:0:(import.c:65:import_set_state_nolock()) ffff9990c2511800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789438319.938842:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 367 00000100:00080000:3.0:1789438319.938847:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789438319.938869:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9990c2511800 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:3.0:1789438319.938916:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9990c26e9180 x1876361769733248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789438319.939341:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1876361769733248:0@lo:38:kworker.0 00000400:00000100:2.0:1789438319.939391:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876361769733248 offset 0 length 520: 4 00010000:00010000:0.0:1789438320.504412:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438321.527214:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789438321.784037:0:13305:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789438321.793908:0:13305:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1789438321.793985:0:13305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff999202044400/0x7a8dd0fcbb924cd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924cda expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438321.793999:0:13305:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff999202044400/0x7a8dd0fcbb924cd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924cda expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438321.794007:0:13305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff999202044400/0x7a8dd0fcbb924cd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7a8dd0fcbb924cda expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438321.794015:0:13305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.109@tcp lock: ffff999202044400/0x7a8dd0fcbb924cd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7a8dd0fcbb924cda expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438321.794036:0:13305:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789438321.794042:0:13305:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789438321.794063:0:13305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789438321.794075:0:13305:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9990c26e9180 x1876361769733248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789438339 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438321.794088:0:13305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789438321.794116:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9990c2511800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789438321.794120:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:2.0:1789438321.794124:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1876361769733248:0@lo:38:kworker.0 00000100:00080000:2.0:1789438321.794161:0:13305:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789438321.794166:0:13305:0:(import.c:65:import_set_state_nolock()) ffff9990c2511800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789438321.794171:0:13305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789438321.794173:0:13305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789438321.794176:0:13305:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789438321.795054:0:13305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924ce1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924ce8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438321.795068:0:13305:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924ce1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924ce8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438321.795076:0:13305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924ce1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7a8dd0fcbb924ce8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438321.795082:0:13305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924ce1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7a8dd0fcbb924ce8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438321.795098:0:13305:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789438321.795104:0:13305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991e74f1e00/0x7a8dd0fcbb924f18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb924f1f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438321.795111:0:13305:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991e74f1e00/0x7a8dd0fcbb924f18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb924f1f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438321.795118:0:13305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991e74f1e00/0x7a8dd0fcbb924f18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7a8dd0fcbb924f1f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438321.795125:0:13305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.109@tcp lock: ffff9991e74f1e00/0x7a8dd0fcbb924f18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7a8dd0fcbb924f1f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438321.795155:0:13305:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1789438321.795158:0:13305:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1789438321.795175:0:13305:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1789438321.795178:0:13305:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1789438321.795182:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789438321.795187:0:13305:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789438321.795192:0:13305:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9991eb25cd40) has no exports 00000020:00080000:2.0:1789438321.795216:0:13305:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9991eb25cd40) has no exports 00010000:00010000:1.0:1789438321.796754:0:11648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789438321.796764:0:11648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff999202044400/0x7a8dd0fcbb924cd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7a8dd0fcbb924cda expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438321.796774:0:11648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999202044400 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:1.0:1789438321.796778:0:11648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff999202044400/0x7a8dd0fcbb924cd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7a8dd0fcbb924cda expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438321.796788:0:11648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff999202044400/0x7a8dd0fcbb924cd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7a8dd0fcbb924cda expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789438321.796795:0:11648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff999202044400/0x7a8dd0fcbb924cd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7a8dd0fcbb924cda expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789438321.796800:0:11648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789438321.796803:0:11648:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789438321.796819:0:11648:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789438321.796835:0:11648:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9991de033000 00010000:00010000:1.0:1789438321.796840:0:11648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff999202044400/0x7a8dd0fcbb924cd3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7a8dd0fcbb924cda expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438321.796847:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff999202044400/0x7a8dd0fcbb924cd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7a8dd0fcbb924cda expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438321.796873:0:11648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789438321.796877:0:11648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924ce1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7a8dd0fcbb924ce8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438321.796883:0:11648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff999202045200 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:1.0:1789438321.796886:0:11648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924ce1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7a8dd0fcbb924ce8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438321.796893:0:11648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924ce1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7a8dd0fcbb924ce8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789438321.796900:0:11648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924ce1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7a8dd0fcbb924ce8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789438321.796905:0:11648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789438321.796907:0:11648:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1789438321.796908:0:11648:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1789438321.796913:0:11648:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9991de033000 00010000:00010000:1.0:1789438321.796916:0:11648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924ce1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7a8dd0fcbb924ce8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438321.796922:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff999202045200/0x7a8dd0fcbb924ce1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7a8dd0fcbb924ce8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438321.796940:0:11648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789438321.796944:0:11648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991e74f1e00/0x7a8dd0fcbb924f18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7a8dd0fcbb924f1f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438321.796950:0:11648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e74f1e00 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:1.0:1789438321.796953:0:11648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991e74f1e00/0x7a8dd0fcbb924f18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7a8dd0fcbb924f1f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438321.796959:0:11648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991e74f1e00/0x7a8dd0fcbb924f18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7a8dd0fcbb924f1f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789438321.796965:0:11648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991e74f1e00/0x7a8dd0fcbb924f18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7a8dd0fcbb924f1f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789438321.796970:0:11648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789438321.796972:0:11648:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789438321.796973:0:11648:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789438321.796977:0:11648:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9991de033000 00010000:00010000:1.0:1789438321.796980:0:11648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991e74f1e00/0x7a8dd0fcbb924f18 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7a8dd0fcbb924f1f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438321.796985:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991e74f1e00/0x7a8dd0fcbb924f18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7a8dd0fcbb924f1f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438321.796995:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438321.796997:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438321.796999:0:11648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438321.797010:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438321.801915:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789438321.808255:0:13305:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9990c3ad4d20 - data ffff9991cf1580d8/ffff9991f3d4cc00 00000020:01000000:2.0:1789438321.808422:0:13305:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9991ff867d80 - data ffff9991ffd14360/ffff9991f3d68000 00100000:10000000:2.0:1789438321.833359:0:13305:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789438321.897247:0:13305:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924bd7 00000020:00000080:2.0:1789438321.897258:0:13305:0:(genops.c:885:class_export_put()) final put ffff9991f4408000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789438321.897278:0:13305:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9991ffa93000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789438321.897281:0:13305:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9991ffa93000 2 00000020:01000004:2.0:1789438321.897285:0:13305:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9991ffa93000 from lustre-OST0001 00000020:00000080:2.0:1789438321.897306:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789438321.897316:0:13305:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789438321.897318:0:13305:0:(genops.c:885:class_export_put()) final put ffff9991f440d000/lustre-OST0001_UUID 00000020:00000080:2.0:1789438321.897320:0:13305:0:(genops.c:844:class_export_destroy()) destroying export ffff9991f440d000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789438321.897326:0:13305:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789438321.897482:0:13305:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 7073a0da-08cf-42fe-8791-a8c6139408f2->MGS 00010000:00010000:2.0:1789438321.897506:0:13305:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991e0967a00/0x7a8dd0fcbb924ae9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7a8dd0fcbb924af0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789438321.897518:0:13305:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991e0967a00/0x7a8dd0fcbb924ae9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7a8dd0fcbb924af0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789438321.897525:0:13305:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789438321.897536:0:13305:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789438321.897538:0:13305:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789438321.897550:0:13305:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9991de033000 00010000:00010000:2.0:1789438321.897554:0:13305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991e0967a00/0x7a8dd0fcbb924ae9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7a8dd0fcbb924af0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438321.897811:0:13305:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991ff9da800/0x7a8dd0fcbb924d27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7a8dd0fcbb924d2e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789438321.897820:0:13305:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991ff9da800/0x7a8dd0fcbb924d27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7a8dd0fcbb924d2e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789438321.897825:0:13305:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789438321.897827:0:13305:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789438321.897829:0:13305:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789438321.897846:0:13305:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9991de033000 00010000:00010000:2.0:1789438321.897849:0:13305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991ff9da800/0x7a8dd0fcbb924d27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7a8dd0fcbb924d2e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789438321.897877:0:13305:0:(import.c:65:import_set_state_nolock()) ffff9991de033000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789438321.897880:0:13305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789438321.897882:0:13305:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789438321.897884:0:13305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789438321.897888:0:13305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789438321.897897:0:13305:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9991ff939180 x1876361769733120/t0(0) o250->MGC192.168.206.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789438328 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789438321.897912:0:13305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789438321.897914:0:13305:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:2.0:1789438321.897941:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7073a0da-08cf-42fe-8791-a8c6139408f2:3308:1876361769733120:0@lo:250:ptlrpcd_00_01.0 10000000:01000000:2.0:1789438321.897965:0:13305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789438321.897970:0:13305:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb9249ca 00000020:00000080:2.0:1789438321.897981:0:13305:0:(genops.c:885:class_export_put()) final put ffff9991de198800/7073a0da-08cf-42fe-8791-a8c6139408f2 00000020:01000000:2.0:1789438321.897988:0:13305:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.109@tcp (flags='') 00000020:00000080:2.0:1789438321.897992:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789438321.897997:0:13305:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.109@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789438321.898000:0:13305:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9991e1e54d40) has no exports 10000000:01000000:0.0:1789438321.898065:0:5836:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:0.0:1789438321.898108:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9991f4408000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789438321.898125:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9991de198800/7073a0da-08cf-42fe-8791-a8c6139408f2 for MGC192.168.206.109@tcp 10000000:01000000:2.0:1789438321.898159:0:13305:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.109@tcp: client import never connected 00000100:00080000:2.0:1789438321.898162:0:13305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789438321.898163:0:13305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789438321.898165:0:13305:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789438321.898167:0:13305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789438321.898231:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789438321.898236:0:13305:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.109@tcp (uuid 7073a0da-08cf-42fe-8791-a8c6139408f2) 00000020:01000000:2.0:1789438321.898240:0:13305:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789438321.898243:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789438321.898246:0:13305:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789438321.898250:0:13305:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9990c2514000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789438321.898255:0:13305:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff9991ffba4d40) has exports, disconnecting them 00000020:00080000:2.0:1789438321.898259:0:13305:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9990c2514000), last request at 1789438130 00000020:00000080:2.0:1789438321.898263:0:13305:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924c01 00000020:00080000:2.0:1789438321.898271:0:13305:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9990c2514000): rc 0 00000020:00000080:2.0:1789438321.898274:0:13305:0:(genops.c:885:class_export_put()) final put ffff9990c2514000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789438321.905228:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9991de033000 for MGC192.168.206.109@tcp 00000020:00000080:0.0:1789438321.905245:0:37:0:(genops.c:885:class_export_put()) final put ffff9991c2b9b800/7073a0da-08cf-42fe-8791-a8c6139408f2 00000020:00000080:0.0:1789438321.905249:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9991c2b9b800/7073a0da-08cf-42fe-8791-a8c6139408f2 for MGC192.168.206.109@tcp 00000020:01000000:0.0:1789438321.905258:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.109@tcp (7073a0da-08cf-42fe-8791-a8c6139408f2) 00000020:00000080:1.0:1789438321.905776:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9990c2514000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789438321.906756:0:13305:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789438321.906762:0:13305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789438321.906766:0:13305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789438321.906773:0:13305:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789438321.907037:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9990c2511800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1789438321.907052:0:11648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1789438321.908006:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1789438321.908395:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1789438321.908533:0:5820:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9991e7527600:5820] 0 exiting: rc = 1 00000100:00100000:1.0:1789438321.908621:0:6695:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9991d0442c00:6695] 2 exiting: rc = 0 00000100:00100000:1.0:1789438321.908679:0:5821:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9991d0fa7600:5821] 1 exiting: rc = 0 00000100:00100000:0.0:1789438321.908784:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.909021:0:5823:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9991d23e5400:5823] 1 exiting: rc = 0 00000100:00100000:0.0:1789438321.909084:0:5822:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9991d23e4000:5822] 0 exiting: rc = 1 00000100:00100000:1.0:1789438321.909373:0:5824:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9991f1137c00:5824] 2 exiting: rc = 0 00000100:00100000:1.0:1789438321.910029:0:8438:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9991ff895a00:8438] 3 exiting: rc = 0 00000100:00100000:0.0:1789438321.911921:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.911931:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.911938:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.911943:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.911949:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.911956:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.911962:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.911967:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.911972:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.911978:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.911983:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.911988:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.911993:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.911999:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912004:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912010:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912017:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912023:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912046:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912052:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912058:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912063:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912071:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912076:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912081:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912087:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912092:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912097:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912102:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912107:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912113:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912118:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912124:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912129:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912135:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912141:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912146:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912152:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912157:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912162:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912167:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912171:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912176:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912181:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912191:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912196:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912202:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912208:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912213:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912219:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912225:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912230:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912235:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912250:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912254:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912259:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912264:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912269:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912274:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912279:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912284:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912289:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912294:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.912299:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789438321.917911:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789438321.917922:0:13305:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789438321.917929:0:13305:0:(genops.c:885:class_export_put()) final put ffff9990c2512000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789438321.917933:0:13305:0:(genops.c:844:class_export_destroy()) destroying export ffff9990c2512000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789438321.917939:0:13305:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1789438321.917988:0:13305:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9991ffa93000 1 00000020:00000080:1.0:1789438321.917993:0:13305:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7a8dd0fcbb924ba6 00000020:00000080:1.0:1789438321.917999:0:13305:0:(genops.c:885:class_export_put()) final put ffff9991eb24b000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1789438321.918016:0:13305:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1789438321.918021:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789438321.918026:0:13305:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789438321.918029:0:13305:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9991ff9999c0) has no exports 00000020:00000080:0.0:1789438321.920441:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9991eb24b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789438321.945523:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789438321.945537:0:13305:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789438321.945543:0:13305:0:(genops.c:885:class_export_put()) final put ffff9991ffa91800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789438321.945547:0:13305:0:(genops.c:844:class_export_destroy()) destroying export ffff9991ffa91800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789438321.945553:0:13305:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789438321.945774:0:13305:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9991ffa91000 00000020:01000000:0.0:1789438321.945813:0:13305:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789438321.945817:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789438321.945821:0:13305:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789438321.945825:0:13305:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9991fae199c0) has no exports 00000020:00000080:0.0:1789438321.945866:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789438321.945874:0:13305:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789438321.945878:0:13305:0:(genops.c:885:class_export_put()) final put ffff9991fae0d800/OSS_uuid 00000020:00000080:0.0:1789438321.945880:0:13305:0:(genops.c:844:class_export_destroy()) destroying export ffff9991fae0d800/OSS_uuid for OSS 00000020:01000000:0.0:1789438321.945886:0:13305:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1789438321.945910:0:5834:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1789438321.946086:0:8192:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9991fabc7000:8192] 3 exiting: rc = 0 00000100:00100000:0.0:1789438321.946147:0:11995:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff9991c6318400:11995] 4 exiting: rc = 0 00000100:00100000:0.0:1789438321.946389:0:6681:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9991e1eb7400:6681] 1 exiting: rc = 0 00000100:00100000:0.0:1789438321.946460:0:6682:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9991d049d000:6682] 2 exiting: rc = 0 00000100:00100000:1.0:1789438321.954959:0:6680:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9991e5003800:6680] 0 exiting: rc = 1 00000100:00100000:0.0:1789438321.955290:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955311:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955318:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955327:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955333:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955339:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955344:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955349:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955354:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955360:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955365:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955370:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955375:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955380:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955385:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955390:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955395:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955400:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955405:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955410:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955415:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955423:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955428:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955433:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955438:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955442:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955447:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955452:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955457:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955462:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955467:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955472:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955477:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955482:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955488:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955493:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955506:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955512:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955518:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955523:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955528:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955533:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955538:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955551:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955556:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955561:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955566:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955571:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955576:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955582:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955587:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955592:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955597:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955603:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955609:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955614:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955619:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955624:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955629:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955634:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955640:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955645:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955650:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.955655:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438321.956602:0:10069:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9991e05cce00:10069] 2 exiting: rc = 0 00000100:00100000:1.0:1789438321.956684:0:6684:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9991fbaec000:6684] 1 exiting: rc = 0 00000100:00100000:2.0:1789438321.990411:0:6683:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9991d055b000:6683] 0 exiting: rc = 1 00000100:00100000:0.0:1789438321.993542:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.993555:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.993561:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.993572:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.993578:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.993583:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.993588:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.993609:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.993614:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.993620:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.993626:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.993631:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.993638:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.994907:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.994919:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.994926:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.994937:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.994943:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.994948:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.994954:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.994960:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.994966:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.994971:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995018:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995027:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995036:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995047:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995052:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995058:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995064:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995069:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995076:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995114:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995123:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995130:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995137:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995142:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995151:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995156:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995160:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995165:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995170:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995186:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995191:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995196:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995201:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995205:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995210:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995215:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995220:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995225:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995230:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995235:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995241:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995246:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995251:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995257:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995262:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995267:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995275:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995281:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995292:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995298:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789438321.995309:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438321.998211:0:6685:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9991fbaede00:6685] 0 exiting: rc = 1 00000100:00100000:2.0:1789438321.998767:0:6686:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9991fbaeca00:6686] 1 exiting: rc = 0 00000100:00100000:3.0:1789438321.999980:0:6687:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9991fbaec200:6687] 2 exiting: rc = 0 00000100:00100000:1.0:1789438322.004026:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004037:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004043:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004049:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004057:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004063:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004088:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004095:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004101:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004108:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004113:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004119:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004125:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004131:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004150:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004156:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004280:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004303:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004310:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004315:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004321:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004326:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004332:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004338:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004343:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004349:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004354:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004360:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004366:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004372:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004378:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004383:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004389:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004395:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004401:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004406:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004412:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004417:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004422:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004427:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004433:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004461:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004468:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004474:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004479:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004485:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004491:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004496:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004502:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004507:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004513:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004519:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004523:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004529:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004535:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004540:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004674:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004681:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004687:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004692:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004697:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004702:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004795:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789438322.004804:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789438322.029082:0:6688:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9991fbaec800:6688] 0 exiting: rc = 1 00000100:00100000:0.0:1789438322.029095:0:6689:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9991fbaec400:6689] 1 exiting: rc = 0 00000100:00100000:2.0:1789438322.029252:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029260:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029265:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029270:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029275:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029280:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029285:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029290:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029308:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029313:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029318:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029323:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029328:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029334:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029338:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029344:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029350:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029355:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029360:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029365:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029369:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029374:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029379:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029384:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029389:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029393:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029398:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029404:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029409:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029419:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029426:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029431:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029443:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029448:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029453:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029458:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029462:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029468:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029473:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029479:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029485:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029490:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029495:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029509:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029514:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029518:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029523:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029529:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029534:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029539:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029544:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029549:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029554:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029559:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029581:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029586:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029591:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029599:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029606:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029611:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029617:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029622:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029628:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.029633:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.034868:0:6691:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9991eb226e00:6691] 1 exiting: rc = 0 00000100:00100000:2.0:1789438322.034991:0:6690:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9991eb226c00:6690] 0 exiting: rc = 1 00000100:00100000:2.0:1789438322.035046:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035058:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035065:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035073:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035079:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035097:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035105:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035113:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035120:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035127:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035135:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035140:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035162:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035167:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035172:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035177:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035182:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035200:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035207:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035214:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035221:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035228:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035235:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035243:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035252:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035258:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035268:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035358:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035365:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035383:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035390:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035396:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035401:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035407:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035413:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035418:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035425:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035433:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035439:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035445:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035450:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035469:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035476:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035481:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035488:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035494:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035501:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035513:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035519:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035525:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035530:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035535:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035542:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035561:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035579:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035585:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035591:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035599:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035605:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035611:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035617:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035623:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035630:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789438322.035636:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789438322.052446:0:13305:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1789438343.886403:0:13922:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg609-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789438353.243526:0:14383:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789438353.243531:0:14383:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1789438353.243658:0:14383:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9991ff9b0800 00000020:01000004:1.0:1789438353.243673:0:14383:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1789438353.243680:0:14383:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789438353.243693:0:14383:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9991ffba4d40) 00000020:00000080:1.0:1789438353.243786:0:14383:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789438353.268605:0:14383:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1789438353.272557:0:14383:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1789438353.273750:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 571: rc = 0 00100000:10000000:1.0:1789438353.274643:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 571: rc = 0 00100000:10000000:1.0:1789438353.274810:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 571: rc = 0 00100000:10000000:1.0:1789438353.275034:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 571: rc = 0 00100000:10000000:1.0:1789438353.275412:0:14383:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1789438353.275488:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 571: rc = 0 00100000:10000000:1.0:1789438353.275592:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 571: rc = 0 00100000:10000000:1.0:1789438353.276143:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 573: rc = 0 00100000:10000000:0.0:1789438353.281382:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 83: rc = 0 00100000:10000000:0.0:1789438353.281494:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 83: rc = 0 00100000:10000000:0.0:1789438353.282212:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 712: rc = 0 00100000:10000000:0.0:1789438353.282567:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 712: rc = 0 00100000:10000000:0.0:1789438353.282832:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 712: rc = 0 00100000:10000000:0.0:1789438353.283210:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 712: rc = 0 00100000:10000000:0.0:1789438353.283543:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 712: rc = 0 00100000:10000000:0.0:1789438353.283944:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 712: rc = 0 00100000:10000000:0.0:1789438353.284465:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 712: rc = 0 00100000:10000000:0.0:1789438353.284819:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 712: rc = 0 00100000:10000000:0.0:1789438353.285129:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 712: rc = 0 00100000:10000000:0.0:1789438353.285456:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 712: rc = 0 00100000:10000000:0.0:1789438353.285804:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 712: rc = 0 00100000:10000000:0.0:1789438353.286133:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 712: rc = 0 00100000:10000000:0.0:1789438353.286634:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 100: rc = 0 00100000:10000000:0.0:1789438353.288794:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 100: rc = 0 00100000:10000000:0.0:1789438353.289482:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 100: rc = 0 00100000:10000000:0.0:1789438353.289945:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 100: rc = 0 00100000:10000000:0.0:1789438353.290238:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 100: rc = 0 00100000:10000000:0.0:1789438353.290816:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 100: rc = 0 00100000:10000000:0.0:1789438353.291160:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 100: rc = 0 00100000:10000000:0.0:1789438353.291545:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 100: rc = 0 00100000:10000000:0.0:1789438353.291940:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 100: rc = 0 00100000:10000000:0.0:1789438353.292158:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 100: rc = 0 00100000:10000000:0.0:1789438353.292562:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 100: rc = 0 00100000:10000000:0.0:1789438353.293145:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 100: rc = 0 00100000:10000000:0.0:1789438353.293483:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 100: rc = 0 00100000:10000000:0.0:1789438353.293846:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 100: rc = 0 00100000:10000000:0.0:1789438353.294194:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 100: rc = 0 00100000:10000000:0.0:1789438353.294539:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 100: rc = 0 00100000:10000000:0.0:1789438353.295142:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 100: rc = 0 00100000:10000000:0.0:1789438353.295475:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 100: rc = 0 00100000:10000000:0.0:1789438353.295927:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 100: rc = 0 00100000:10000000:0.0:1789438353.296183:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 100: rc = 0 00100000:10000000:0.0:1789438353.296519:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 100: rc = 0 00100000:10000000:0.0:1789438353.297104:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 100: rc = 0 00100000:10000000:0.0:1789438353.297392:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 100: rc = 0 00100000:10000000:0.0:1789438353.297807:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 100: rc = 0 00100000:10000000:0.0:1789438353.298140:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 100: rc = 0 00100000:10000000:0.0:1789438353.298548:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 100: rc = 0 00100000:10000000:0.0:1789438353.298884:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 100: rc = 0 00100000:10000000:0.0:1789438353.299126:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 100: rc = 0 00100000:10000000:0.0:1789438353.299388:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 100: rc = 0 00100000:10000000:0.0:1789438353.299634:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 100: rc = 0 00100000:10000000:0.0:1789438353.300968:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 100: rc = 0 00100000:10000000:0.0:1789438353.301233:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 100: rc = 0 00100000:10000000:0.0:1789438353.305274:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 91: rc = 0 00100000:10000000:0.0:1789438353.307932:0:14383:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1789438353.308106:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 84: rc = 0 00100000:10000000:1.0:1789438353.309050:0:14383:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1789438353.309157:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 84: rc = 0 00100000:10000000:1.0:1789438353.309435:0:14383:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1789438353.309507:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 84: rc = 0 00100000:10000000:1.0:1789438353.310089:0:14383:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1789438353.310162:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 88: rc = 0 00100000:10000000:1.0:1789438353.310429:0:14383:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1789438353.310497:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 88: rc = 0 00100000:10000000:1.0:1789438353.310792:0:14383:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1789438353.311212:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 88: rc = 0 00000020:00000080:1.0:1789438353.311827:0:14383:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789438353.311834:0:14383:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789438353.311841:0:14383:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7a8dd0fcbb925cbd 00000020:01000004:1.0:1789438353.311849:0:14383:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1789438353.311853:0:14383:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789438353.311922:0:14383:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9991ff9b0800 from MGS 00000020:01000004:1.0:1789438353.311926:0:14383:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789438353.311935:0:14383:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9991ffba3380) 00000020:00000080:1.0:1789438353.311945:0:14383:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789438353.311990:0:14383:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9991ff9b0800 from MGS, refs=2 00080000:01000000:1.0:1789438353.311994:0:14383:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789438353.311998:0:14383:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7a8dd0fcbb925ccb 00000100:00100000:1.0:1789438353.312083:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789438353.312207:0:14383:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789438353.312214:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789438353.312944:0:14383:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789438353.312951:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789438353.313592:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789438353.313978:0:14383:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789438353.313983:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789438353.314445:0:14383:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789438353.314451:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789438353.314825:0:14383:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789438353.314831:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789438353.315642:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438353.315645:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438353.315647:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438353.316148:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438353.316150:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438353.316152:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438353.316962:0:14383:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789438353.323029:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789438353.329793:0:14383:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1789438353.329811:0:14383:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789438353.329814:0:14383:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1789438353.331498:0:14393:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789438353.331623:0:14383:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789438353.331787:0:14383:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789438353.332235:0:14383:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789438353.332546:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789438353.332696:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789438353.332737:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789438353.333890:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789438353.333899:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789438353.334274:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789438353.334280:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789438353.339059:0:14383:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789438353.339081:0:14383:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.109@tcp' 00000020:01000004:1.0:1789438353.339082:0:14383:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789438353.339111:0:14383:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.109@tcp (typ=mgc) 00000020:00000080:1.0:1789438353.339122:0:14383:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.109@tcp (ffff9991ffba19c0) 00000020:00000080:1.0:1789438353.339137:0:14383:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789438353.339209:0:14383:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9991e0112800@MGC192.168.206.109@tcp: add connection 192.168.206.109@tcp at head 00010000:00010000:1.0:1789438353.339361:0:14383:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.109@tcp-0 is initialized 00000040:01000000:1.0:1789438353.339367:0:14383:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.109@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789438353.339839:0:14397:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1789438353.340925:0:14399:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789438353.345146:0:14383:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.109@tcp (uuid b3666e65-cb7a-452a-a637-b1a251df2a46) 00000020:00000080:1.0:1789438353.345171:0:14383:0:(genops.c:1384:class_connect()) connect: client b3666e65-cb7a-452a-a637-b1a251df2a46, cookie 0x7a8dd0fcbb925cd9 00000100:00080000:1.0:1789438353.345193:0:14383:0:(import.c:545:import_select_connection()) MGC192.168.206.109@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789438353.345205:0:14383:0:(import.c:666:import_select_connection()) MGC192.168.206.109@tcp: import ffff9991e0112800 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:1.0:1789438353.345238:0:14383:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9991faab5500 x1876361769733376/t0(0) o250->MGC192.168.206.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789438353.345310:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b3666e65-cb7a-452a-a637-b1a251df2a46:3308:1876361769733376:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789438353.345374:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438353.345521:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769733376 00000100:00100000:3.0:1789438353.345528:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769733376 00000100:00100000:3.0:1789438353.345569:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789438353.345579:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d080b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3308:x1876361769733376:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1789438353.345601:0:14394:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from b3666e65-cb7a-452a-a637-b1a251df2a46@0@lo t0 exp 0000000000000000 cur 405 last 0 00000020:00000080:3.0:1789438353.345636:0:14394:0:(genops.c:1384:class_connect()) connect: client b3666e65-cb7a-452a-a637-b1a251df2a46, cookie 0x7a8dd0fcbb925ce0 00000100:00080000:3.0:1789438353.345794:0:14394:0:(import.c:65:import_set_state_nolock()) ffff9991fae0d800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1789438353.346022:0:14383:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import b3666e65-cb7a-452a-a637-b1a251df2a46->MGS 00000020:01000004:1.0:1789438353.346045:0:14383:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789438353.346050:0:14383:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789438353.346062:0:14383:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9991ffba0000) 00000020:00000080:1.0:1789438353.346072:0:14383:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789438353.355793:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d080b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+5:3308:x1876361769733376:12345-0@lo:250:mount.lustre.0 Request processed in 10194us (10399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438353.355808:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789438353.356430:0:3308:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.109@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789438353.356442:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.206.109@tcp: connect to target with instance 0 00000100:00080000:2.0:1789438353.356450:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.206.109@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789438353.356455:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789438353.356459:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9991e0112800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789438353.356462:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789438353.356474:0:3308:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789438353.356479:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b3666e65-cb7a-452a-a637-b1a251df2a46:3308:1876361769733376:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789438353.362384:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789438353.362570:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789438353.362577:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789438353.363610:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789438353.363619:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789438353.364414:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789438353.364422:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789438353.365322:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789438353.365480:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789438353.365486:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789438353.366087:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789438353.366094:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789438353.397124:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789438353.397410:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789438353.397416:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789438353.398579:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789438353.398589:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789438353.399454:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789438353.399602:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789438353.399609:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789438353.400197:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789438353.400204:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789438353.400930:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789438353.401089:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789438353.401095:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789438353.401606:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789438353.401614:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789438353.402497:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789438353.402644:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789438353.402650:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789438353.403269:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789438353.403276:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789438353.423872:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789438353.424070:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789438353.424076:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789438353.426988:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789438353.427003:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789438353.428508:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789438353.428522:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789438353.429682:0:14383:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789438353.429933:0:14383:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1789438353.429940:0:14383:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.109@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789438353.430071:0:14383:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.109@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789438353.430101:0:14383:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.109@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1789438353.430106:0:14383:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789438353.430107:0:14383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789438353.430109:0:14383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789438353.430113:0:14383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789438353.430115:0:14383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789438353.430116:0:14383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789438353.430117:0:14383:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789438353.430119:0:14383:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789438353.430120:0:14383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789438353.430121:0:14383:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789438353.430123:0:14383:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1789438353.430125:0:14383:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789438353.430126:0:14383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789438353.430128:0:14383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789438353.430129:0:14383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789438353.430130:0:14383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789438353.430131:0:14383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789438353.430132:0:14383:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789438353.430133:0:14383:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789438353.430134:0:14383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789438353.430135:0:14383:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789438353.430161:0:14383:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789438353.430451:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff939880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769733504:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789438353.430524:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438353.430613:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d019c180 going to sleep for 11 seconds 00000100:00100000:1.0:1789438353.430677:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769733504 00000100:00100000:1.0:1789438353.430684:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769733504 00000100:00100000:1.0:1789438353.430970:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789438353.430980:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d080b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+5:14383:x1876361769733504:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789438353.431039:0:14396:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789438353.431042:0:14396:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789438353.431046:0:14396:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789438353.431539:0:14417:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789438353.434425:0:14396:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1789438353.436254:0:14418:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1789438353.436262:0:14418:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1789438353.436264:0:14418:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1789438353.436384:0:14418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1789438353.436682:0:14396:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789438353.436694:0:14396:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789438353.444196:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d080b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+5:14383:x1876361769733504:12345-0@lo:253:mount.lustre.0 Request processed in 13209us (13663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438353.444211:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789438353.444407:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff939880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769733504:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789438353.444422:0:14383:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789438353.444425:0:14383:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789438353.444427:0:14383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789438353.444428:0:14383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789438353.444429:0:14383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789438353.444431:0:14383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789438353.444432:0:14383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789438353.444434:0:14383:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789438353.444435:0:14383:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789438353.444436:0:14383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789438353.444438:0:14383:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789438353.444457:0:14383:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9991ff9b0800 from lustre-MDT0000 10000000:01000000:0.0:1789438353.444482:0:14383:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789438353.444484:0:14383:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789438353.444502:0:14383:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9991ffba19c0 10000000:01000000:0.0:1789438353.444506:0:14383:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789438353.444513:0:14383:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9991ffba19c0 from 1 10000000:01000000:0.0:1789438353.444516:0:14383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789438353.444551:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991f3d62800/0x7a8dd0fcbb925cee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438353.444561:0:14383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991f3d62800/0x7a8dd0fcbb925cee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438353.444571:0:14383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991f3d62800/0x7a8dd0fcbb925cee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438353.444589:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff939880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769733632:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789438353.444623:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438353.444697:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d59e6480 going to sleep for 11 seconds 00000100:00100000:3.0:1789438353.446406:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769733632 00000100:00100000:3.0:1789438353.446418:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769733632 00000100:00100000:3.0:1789438353.446473:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789438353.446483:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d0809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+5:14383:x1876361769733632:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789438353.446498:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438353.446517:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c2a54a00/0x7a8dd0fcbb925cf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb925cee expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.446541:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c2a54a00/0x7a8dd0fcbb925cf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925cee expref: 6 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.446554:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c2a54a00/0x7a8dd0fcbb925cf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925cee expref: 6 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.446562:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a54a00, rc 0) 00000100:00100000:1.0:1789438353.446978:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff939880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769733632:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789438353.446997:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991f3d62800/0x7a8dd0fcbb925cee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925cf5 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438353.447008:0:14383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991f3d62800/0x7a8dd0fcbb925cee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb925cf5 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438353.447584:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d0809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+6:14383:x1876361769733632:12345-0@lo:101:mount.lustre.0 Request processed in 1099us (2957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438353.447593:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789438353.447798:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769733760:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789438353.447846:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438353.448105:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991ffbbc6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438353.448154:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769733760 00000100:00100000:3.0:1789438353.448160:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769733760 00000100:00100000:3.0:1789438353.448203:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789438353.448212:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d0809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+6:14383:x1876361769733760:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789438353.450178:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d0809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+6:14383:x1876361769733760:12345-0@lo:501:mount.lustre.0 Request processed in 1960us (2325us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789438353.450191:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789438353.450465:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769733760:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789438353.450502:0:14383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789438353.450537:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991f3d62800/0x7a8dd0fcbb925cee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925cf5 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438353.450548:0:14383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991f3d62800/0x7a8dd0fcbb925cee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925cf5 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789438353.450556:0:14383:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9991ff9b0800 10000000:01000000:1.0:1789438353.450561:0:14383:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789438353.450565:0:14383:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9991ff9b0800 10000000:01000000:1.0:1789438353.450567:0:14383:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789438353.450570:0:14383:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9991ff9b0800 from 1 10000000:01000000:1.0:1789438353.450573:0:14383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789438353.450605:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb925cfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438353.450614:0:14383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb925cfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438353.450624:0:14383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb925cfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438353.450751:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769733888:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789438353.450789:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438353.450820:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991ffbbc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789438353.451000:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769733888 00000100:00100000:0.0:1789438353.451007:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769733888 00000100:00100000:0.0:1789438353.451048:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789438353.451057:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d0808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+6:14383:x1876361769733888:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789438353.451067:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438353.451080:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991f3d63800/0x7a8dd0fcbb925d03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb925cfc expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438353.451101:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991f3d63800/0x7a8dd0fcbb925d03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925cfc expref: 7 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438353.451112:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991f3d63800/0x7a8dd0fcbb925d03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925cfc expref: 7 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438353.451132:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63800, rc 0) 00000100:00100000:0.0:1789438353.451163:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d0808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+7:14383:x1876361769733888:12345-0@lo:101:mount.lustre.0 Request processed in 107us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438353.451169:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789438353.451380:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769733888:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789438353.451392:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb925cfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925d03 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438353.451400:0:14383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb925cfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb925d03 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789438353.451420:0:14383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789438353.451424:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb925cfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925d03 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438353.451430:0:14383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991ff9db200/0x7a8dd0fcbb925cfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925d03 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789438353.451435:0:14383:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789438353.451439:0:14383:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789438353.451443:0:14383:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9991ff9b0800 10000000:01000000:1.0:1789438353.451446:0:14383:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789438353.451449:0:14383:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789438353.451451:0:14383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789438353.451465:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9da800/0x7a8dd0fcbb925d0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438353.451473:0:14383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991ff9da800/0x7a8dd0fcbb925d0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438353.451480:0:14383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991ff9da800/0x7a8dd0fcbb925d0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438353.451493:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769734016:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789438353.451519:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438353.451550:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991ffbbc6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438353.451600:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769734016 00000100:00100000:3.0:1789438353.451605:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769734016 00000100:00100000:3.0:1789438353.451738:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789438353.451746:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d080a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+7:14383:x1876361769734016:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789438353.451753:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438353.451761:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c2a54600/0x7a8dd0fcbb925d11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb925d0a expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.451776:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c2a54600/0x7a8dd0fcbb925d11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925d0a expref: 8 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.451784:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c2a54600/0x7a8dd0fcbb925d11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925d0a expref: 8 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.451790:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a54600, rc 0) 00000100:00100000:3.0:1789438353.451819:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d080a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+8:14383:x1876361769734016:12345-0@lo:101:mount.lustre.0 Request processed in 75us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438353.451827:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789438353.452116:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769734016:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789438353.452127:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991ff9da800/0x7a8dd0fcbb925d0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925d11 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438353.452142:0:14383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991ff9da800/0x7a8dd0fcbb925d0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb925d11 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438353.452190:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769734144:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789438353.452755:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438353.452782:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991ffbbc6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438353.452955:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769734144 00000100:00100000:3.0:1789438353.452961:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769734144 00000100:00100000:3.0:1789438353.453027:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789438353.453035:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d080ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+8:14383:x1876361769734144:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789438353.453446:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d080ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+9:14383:x1876361769734144:12345-0@lo:501:mount.lustre.0 Request processed in 411us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438353.453454:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789438353.453532:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769734144:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789438353.453570:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769734272:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789438353.453610:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438353.464790:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769734272 00000100:00100000:0.0:1789438353.464806:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769734272 00000100:00100000:0.0:1789438353.464979:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789438353.464990:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d080a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+9:14383:x1876361769734272:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789438353.465546:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d080a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+9:14383:x1876361769734272:12345-0@lo:503:mount.lustre.0 Request processed in 556us (11933us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438353.465554:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789438353.466436:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991ffbbc6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789438353.466465:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769734272:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789438353.467162:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3666e65-cb7a-452a-a637-b1a251df2a46:14419:1876361769734400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789438353.467232:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438353.467264:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d0660e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789438353.467435:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769734400 00000100:00100000:0.0:1789438353.467442:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769734400 00000100:00100000:0.0:1789438353.467486:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789438353.467495:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d0808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+9:14419:x1876361769734400:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789438353.467970:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d0808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+9:14419:x1876361769734400:12345-0@lo:502:llog_process_th.0 Request processed in 474us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438353.467978:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789438353.468756:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3666e65-cb7a-452a-a637-b1a251df2a46:14419:1876361769734400:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789438353.468789:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789438353.468799:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438353.468801:0:14419:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789438353.468806:0:14419:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789438353.468809:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789438353.468825:0:14419:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9991e1e54d40) 00000020:00000080:1.0:1789438353.468840:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789438353.468846:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789438353.468983:0:14419:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789438353.468991:0:14419:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7a8dd0fcbb925d1f 00000020:00000080:1.0:1789438353.469194:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789438353.469199:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789438353.469203:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438353.469779:0:14419:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789438353.469786:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789438353.469792:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438353.469794:0:14419:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789438353.469798:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789438353.469810:0:14419:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9991e1e50000) 00000020:00000080:1.0:1789438353.469821:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789438353.469826:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789438353.469828:0:14419:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789438353.469830:0:14419:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789438353.469836:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789438353.469952:0:14419:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9991ff9b0800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789438353.469966:0:14419:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9991e1e519c0) 00000020:00000080:1.0:1789438353.469974:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789438353.470031:0:14419:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789438353.470038:0:14419:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7a8dd0fcbb925d34 00000020:00000080:1.0:1789438353.470136:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789438353.470142:0:14419:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789438353.470147:0:14419:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x7a8dd0fcbb925d3b 00080000:01000000:1.0:1789438353.470151:0:14419:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789438353.470156:0:14419:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7a8dd0fcbb925d42 00010000:00010000:2.0:1789438353.594617:0:14419:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789438353.595251:0:14419:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1789438353.600508:0:14419:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789438353.601399:0:14419:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9991eb258000) 00000020:00000080:3.0:1789438353.601420:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789438353.601485:0:14419:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789438353.601492:0:14419:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7a8dd0fcbb925d50 00000020:00000080:3.0:1789438353.602285:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789438353.611052:0:14419:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x7a8dd0fcbb925d57 00000020:00000080:3.0:1789438353.611643:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789438353.611654:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789438353.611660:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789438353.611662:0:14419:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789438353.611665:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789438353.611668:0:14419:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1789438353.611669:0:14419:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789438353.611671:0:14419:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789438353.611672:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789438353.611674:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789438353.611676:0:14419:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789438353.611678:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789438353.611682:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789438353.611683:0:14419:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789438353.611688:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789438353.611757:0:14419:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789438353.611773:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789438353.611776:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789438353.611778:0:14419:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789438353.611780:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789438353.611784:0:14419:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789438353.611793:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789438353.611795:0:14419:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789438353.611798:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789438353.611803:0:14419:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.109@tcp to nid 0x20000c0a8ce6d (192.168.206.109@tcp) 00000020:01000000:3.0:1789438353.611827:0:14419:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789438353.611829:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789438353.611844:0:14419:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9991eb25b380) 00000020:00000080:3.0:1789438353.611928:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789438353.611936:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789438353.611991:0:14419:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789438353.611997:0:14419:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789438353.612004:0:14419:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7a8dd0fcbb925d65 00010000:00080000:3.0:1789438353.612033:0:14419:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9991ffafb800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.109@tcp at head 00010000:00010000:3.0:1789438353.612261:0:14419:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1789438353.613781:0:14419:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789438353.613830:0:14419:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789438353.622500:0:14419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789438353.622575:0:14419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1789438353.622644:0:14419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1789438353.624449:0:14423:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789438353.624455:0:14423:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789438353.625474:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789438353.625488:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789438353.625523:0:14419:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789438353.625542:0:14419:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7a8dd0fcbb925d6c 00000100:00080000:0.0:1789438353.625552:0:14419:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789438353.625563:0:14419:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9991ffafb800 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:0.0:1789438353.625602:0:14419:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9991ff939c00 x1876361769734528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789438353.625629:0:14419:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789438353.625686:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789438353.625691:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789438353.625693:0:14419:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789438353.625696:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789438353.625698:0:14419:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1789438353.625734:0:14419:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789438353.625736:0:14419:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789438353.625738:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789438353.625742:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789438353.625743:0:14419:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789438353.625745:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789438353.625749:0:14419:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789438353.625751:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789438353.625752:0:14419:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789438353.625755:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789438353.625758:0:14419:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.109@tcp to nid 0x20000c0a8ce6d (192.168.206.109@tcp) 00000020:01000000:0.0:1789438353.625795:0:14419:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789438353.625798:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789438353.625809:0:14419:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9991fa9b4d40) 00000020:00000080:0.0:1789438353.625820:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1789438353.625825:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1789438353.626135:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876361769734528:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789438353.626184:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876361769734528 offset 0 length 520: 4 00000004:00080000:0.0:1789438353.626693:0:14419:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789438353.626731:0:14419:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789438353.626739:0:14419:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7a8dd0fcbb925d7a 00010000:00080000:0.0:1789438353.627361:0:14419:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9991de19a800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.109@tcp at head 00010000:00010000:0.0:1789438353.627591:0:14419:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1789438353.629052:0:14419:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789438353.629080:0:14419:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789438353.629657:0:14419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789438353.630434:0:14419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1789438353.631110:0:14419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1789438353.632813:0:14425:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789438353.632820:0:14425:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789438353.637184:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789438353.637200:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789438353.637243:0:14419:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789438353.637263:0:14419:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7a8dd0fcbb925d81 00000100:00080000:1.0:1789438353.637273:0:14419:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789438353.637284:0:14419:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9991de19a800 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:1.0:1789438353.637330:0:14419:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9991faab7b80 x1876361769734656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789438353.637379:0:14419:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789438353.637435:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789438353.637440:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438353.637442:0:14419:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789438353.637445:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789438353.637448:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438353.637450:0:14419:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789438353.637453:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789438353.637455:0:14419:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789438353.637458:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789438353.637460:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438353.637461:0:14419:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789438353.637463:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789438353.637465:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438353.637466:0:14419:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789438353.637470:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789438353.637499:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3666e65-cb7a-452a-a637-b1a251df2a46:14419:1876361769734784:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789438353.637571:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438353.637615:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769734784 00000100:00100000:1.0:1789438353.637621:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769734784 00000100:00100000:1.0:1789438353.637658:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789438353.637666:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d080b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+9:14419:x1876361769734784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789438353.638027:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876361769734656:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789438353.638067:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876361769734656 offset 0 length 520: 4 00000100:00100000:1.0:1789438353.638267:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d080b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+9:14419:x1876361769734784:12345-0@lo:502:llog_process_th.0 Request processed in 600us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438353.638275:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789438353.638498:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d0660480 going to sleep for 11 seconds 00000100:00100000:1.0:1789438353.638520:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3666e65-cb7a-452a-a637-b1a251df2a46:14419:1876361769734784:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789438353.638546:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789438353.638556:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438353.638558:0:14419:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789438353.638564:0:14419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1789438353.646744:0:14383:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1789438353.646781:0:14383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789438353.646811:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9da800/0x7a8dd0fcbb925d0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925d11 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438353.646825:0:14383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991ff9da800/0x7a8dd0fcbb925d0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925d11 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789438353.646931:0:14383:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9991ff9b0800 from 1 10000000:01000000:3.0:1789438353.646935:0:14383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789438353.646979:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb925d88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.646988:0:14383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb925d88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.646998:0:14383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb925d88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438353.647022:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769734912:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789438353.647101:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438353.647142:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d5b3bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789438353.647398:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769734912 00000100:00100000:0.0:1789438353.647406:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769734912 00000100:00100000:0.0:1789438353.647455:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789438353.647465:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f5501050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+9:14383:x1876361769734912:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789438353.647477:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438353.647491:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991f3d62c00/0x7a8dd0fcbb925d8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb925d88 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438353.647514:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991f3d62c00/0x7a8dd0fcbb925d8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925d88 expref: 10 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438353.647524:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991f3d62c00/0x7a8dd0fcbb925d8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925d88 expref: 10 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438353.647532:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d62c00, rc 0) 00000100:00100000:0.0:1789438353.647580:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f5501050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+10:14383:x1876361769734912:12345-0@lo:101:mount.lustre.0 Request processed in 117us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438353.647587:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789438353.649644:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769734912:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789438353.649685:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb925d88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925d8f expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.649729:0:14383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb925d88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb925d8f expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438353.650513:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769735040:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789438353.650582:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438353.650631:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d5b3bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789438353.650789:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769735040 00000100:00100000:1.0:1789438353.650797:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769735040 00000100:00100000:1.0:1789438353.650840:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789438353.650850:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f5500450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+10:14383:x1876361769735040:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789438353.650882:0:14394:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789438353.650888:0:14394:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789438353.650969:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f5500450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+10:14383:x1876361769735040:12345-0@lo:256:mount.lustre.0 Request processed in 120us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438353.650977:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789438353.654033:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769735040:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789438353.654591:0:14383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789438353.654624:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb925d88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925d8f expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.654636:0:14383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb925d88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925d8f expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789438353.654645:0:14383:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9991ff9b0800 from 1 10000000:01000000:3.0:1789438353.654648:0:14383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789438353.654687:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c2a54c00/0x7a8dd0fcbb925d96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.654694:0:14383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991c2a54c00/0x7a8dd0fcbb925d96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.659929:0:14383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991c2a54c00/0x7a8dd0fcbb925d96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438353.660144:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769735168:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789438353.660234:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438353.660275:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d9e09000 going to sleep for 11 seconds 00000100:00100000:1.0:1789438353.660291:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769735168 00000100:00100000:1.0:1789438353.660300:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769735168 00000100:00100000:1.0:1789438353.660357:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789438353.660367:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f5503c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+10:14383:x1876361769735168:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789438353.660381:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438353.660400:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991ff9dac00/0x7a8dd0fcbb925d9d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb925d96 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438353.660427:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991ff9dac00/0x7a8dd0fcbb925d9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925d96 expref: 11 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438353.660438:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991ff9dac00/0x7a8dd0fcbb925d9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925d96 expref: 11 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438353.660446:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9dac00, rc 0) 00000100:00100000:1.0:1789438353.660494:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f5503c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+11:14383:x1876361769735168:12345-0@lo:101:mount.lustre.0 Request processed in 129us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438353.660510:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769735168:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789438353.660511:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1789438353.660535:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991c2a54c00/0x7a8dd0fcbb925d96 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925d9d expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438353.660553:0:14383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991c2a54c00/0x7a8dd0fcbb925d96 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb925d9d expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438353.660622:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff938000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769735296:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789438353.660648:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438353.660675:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d9e09000 going to sleep for 11 seconds 00000100:00100000:3.0:1789438353.661232:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769735296 00000100:00100000:3.0:1789438353.661240:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769735296 00000100:00100000:3.0:1789438353.661277:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789438353.661286:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f5500c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+11:14383:x1876361769735296:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789438353.662629:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f5500c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+11:14383:x1876361769735296:12345-0@lo:501:mount.lustre.0 Request processed in 1341us (1976us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438353.662639:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789438353.663484:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff938000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769735296:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789438353.663539:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff938000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769735424:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789438353.663594:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438353.663634:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d9e09000 going to sleep for 11 seconds 00000100:00100000:2.0:1789438353.663679:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769735424 00000100:00100000:2.0:1789438353.663686:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769735424 00000100:00100000:2.0:1789438353.663765:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789438353.663775:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f5503050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+11:14383:x1876361769735424:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789438353.663930:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f5503050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+11:14383:x1876361769735424:12345-0@lo:503:mount.lustre.0 Request processed in 156us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438353.663938:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789438353.664092:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff938000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769735424:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789438353.664956:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff938000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3666e65-cb7a-452a-a637-b1a251df2a46:14427:1876361769735552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789438353.665016:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438353.665095:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d06606c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438353.665138:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769735552 00000100:00100000:3.0:1789438353.665144:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769735552 00000100:00100000:3.0:1789438353.665230:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789438353.665239:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f5502450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+11:14427:x1876361769735552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789438353.665476:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f5502450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+11:14427:x1876361769735552:12345-0@lo:502:llog_process_th.0 Request processed in 237us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438353.665484:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789438353.665556:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff938000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3666e65-cb7a-452a-a637-b1a251df2a46:14427:1876361769735552:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789438353.665579:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789438353.665588:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438353.665591:0:14427:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789438353.665598:0:14427:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9991ff9b0800 00000020:00000080:1.0:1789438353.665601:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789438353.665608:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789438353.665610:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438353.665611:0:14427:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789438353.665614:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789438353.665616:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438353.665618:0:14427:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789438353.665621:0:14427:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9991ff9b0800 00000020:00000080:1.0:1789438353.665623:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789438353.665682:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789438353.665686:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438353.665687:0:14427:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789438353.665690:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789438353.665692:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438353.665693:0:14427:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789438353.665696:0:14427:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9991ff9b0800 00000020:00000080:1.0:1789438353.665698:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789438353.665766:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3666e65-cb7a-452a-a637-b1a251df2a46:14427:1876361769735680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789438353.665800:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438353.676332:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769735680 00000100:00100000:2.0:1789438353.676347:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769735680 00000100:00100000:1.0:1789438353.676395:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d06606c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789438353.676410:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789438353.676421:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f5501850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+11:14427:x1876361769735680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789438353.677309:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f5501850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+11:14427:x1876361769735680:12345-0@lo:502:llog_process_th.0 Request processed in 886us (11503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438353.677319:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789438353.679325:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3666e65-cb7a-452a-a637-b1a251df2a46:14427:1876361769735680:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789438353.679380:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789438353.679391:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438353.679393:0:14427:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789438353.679399:0:14427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789438353.679616:0:14383:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789438353.679737:0:14383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789438353.679757:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c2a54c00/0x7a8dd0fcbb925d96 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925d9d expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438353.679768:0:14383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991c2a54c00/0x7a8dd0fcbb925d96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925d9d expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789438353.679810:0:14383:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789438353.679813:0:14383:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9991ff9b0800 10000000:01000000:2.0:1789438353.679816:0:14383:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9991ff9b0800 10000000:01000000:2.0:1789438353.679820:0:14383:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789438353.679826:0:14383:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9991ff9b0800 from 1 10000000:01000000:2.0:1789438353.679828:0:14383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789438353.679876:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c69e0000/0x7a8dd0fcbb925da4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438353.679885:0:14383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991c69e0000/0x7a8dd0fcbb925da4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438353.679895:0:14383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991c69e0000/0x7a8dd0fcbb925da4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438353.679920:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769735808:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789438353.679990:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438353.680036:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d35be540 going to sleep for 11 seconds 00000100:00100000:1.0:1789438353.680119:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769735808 00000100:00100000:1.0:1789438353.680126:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769735808 00000100:00100000:1.0:1789438353.680172:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789438353.680181:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f5500850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+11:14383:x1876361769735808:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789438353.680192:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438353.680204:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991ff9da200/0x7a8dd0fcbb925dab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb925da4 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438353.680227:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991ff9da200/0x7a8dd0fcbb925dab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925da4 expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438353.680237:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991ff9da200/0x7a8dd0fcbb925dab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925da4 expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438353.680245:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991ff9da200, rc 0) 00000100:00100000:1.0:1789438353.680294:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f5500850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+12:14383:x1876361769735808:12345-0@lo:101:mount.lustre.0 Request processed in 114us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438353.680301:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789438353.680397:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769735808:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789438353.680411:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991c69e0000/0x7a8dd0fcbb925da4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925dab expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438353.680432:0:14383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991c69e0000/0x7a8dd0fcbb925da4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb925dab expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438353.680484:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769735936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789438353.680517:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438353.680687:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769735936 00000100:00100000:1.0:1789438353.680692:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769735936 00000100:00100000:2.0:1789438353.680698:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d35be540 going to sleep for 11 seconds 00000100:00100000:1.0:1789438353.680754:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789438353.680762:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f5501450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+12:14383:x1876361769735936:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789438353.681371:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f5501450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+12:14383:x1876361769735936:12345-0@lo:501:mount.lustre.0 Request processed in 607us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438353.681387:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789438353.682601:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769735936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789438353.682650:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769736064:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789438353.682728:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438353.682771:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d35be540 going to sleep for 11 seconds 00000100:00100000:0.0:1789438353.684498:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769736064 00000100:00100000:0.0:1789438353.684510:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769736064 00000100:00100000:0.0:1789438353.684557:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789438353.684580:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f5502850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+12:14383:x1876361769736064:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789438353.684841:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f5502850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+12:14383:x1876361769736064:12345-0@lo:503:mount.lustre.0 Request processed in 263us (2113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438353.684849:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789438353.685080:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769736064:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789438353.691880:0:14432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3666e65-cb7a-452a-a637-b1a251df2a46:14432:1876361769736192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789438353.691975:0:14432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438353.692018:0:14432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c5e6c180 going to sleep for 11 seconds 00000100:00100000:2.0:1789438353.692397:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769736192 00000100:00100000:2.0:1789438353.692406:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769736192 00000100:00100000:2.0:1789438353.692457:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789438353.692467:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f5503450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+12:14432:x1876361769736192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789438353.692734:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f5503450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+12:14432:x1876361769736192:12345-0@lo:502:llog_process_th.0 Request processed in 268us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438353.692742:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789438353.692860:0:14432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3666e65-cb7a-452a-a637-b1a251df2a46:14432:1876361769736192:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789438353.692916:0:14432:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789438353.692931:0:14432:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9991eb2599c0) 00000020:00000080:3.0:1789438353.692950:0:14432:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1789438353.693082:0:14432:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9991ff9b0800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789438353.693092:0:14432:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9991ff9b0800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789438353.693095:0:14432:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9991ff9b0800 4 00010000:00080000:3.0:1789438353.693130:0:14432:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9991fbad0000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.109@tcp at head 00010000:00010000:3.0:1789438353.696275:0:14432:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1789438353.701494:0:14432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789438353.701531:0:14432:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789438353.701543:0:14432:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x7a8dd0fcbb925db9 00000100:00080000:3.0:1789438353.701553:0:14432:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789438353.701564:0:14432:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9991fbad0000 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:3.0:1789438353.701596:0:14432:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9990c26ead80 x1876361769736320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789438353.701622:0:14432:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789438353.701661:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876361769736320:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789438353.701762:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438353.701843:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769736320 00000100:00100000:2.0:1789438353.701851:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769736320 00000100:00100000:2.0:1789438353.701881:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789438353.701888:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1876361769736320:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789438353.701945:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1876361769736320:12345-0@lo:38:llog_process_th.0 Request processed in 56us (184us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789438353.701952:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789438353.702006:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789438353.702015:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9991fbad0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789438353.702019:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789438353.702023:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876361769736320:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789438353.705887:0:14432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3666e65-cb7a-452a-a637-b1a251df2a46:14432:1876361769736448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789438353.705963:0:14432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438353.706004:0:14432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c5e6ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1789438353.706013:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769736448 00000100:00100000:2.0:1789438353.706022:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769736448 00000100:00100000:2.0:1789438353.706071:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789438353.706080:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+12:14432:x1876361769736448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789438353.706316:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+12:14432:x1876361769736448:12345-0@lo:502:llog_process_th.0 Request processed in 236us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438353.706324:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789438353.706391:0:14432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b3666e65-cb7a-452a-a637-b1a251df2a46:14432:1876361769736448:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789438353.706419:0:14432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789438353.706476:0:14383:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789438353.706495:0:14383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789438353.706508:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c69e0000/0x7a8dd0fcbb925da4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925dab expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.706521:0:14383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991c69e0000/0x7a8dd0fcbb925da4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925dab expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789438353.706564:0:14383:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789438353.706566:0:14383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789438353.706568:0:14383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789438353.706574:0:14383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789438353.706575:0:14383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789438353.706576:0:14383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789438353.706577:0:14383:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789438353.706579:0:14383:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789438353.706580:0:14383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789438353.706582:0:14383:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789438353.706585:0:14383:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1789438353.706588:0:14383:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789438353.706589:0:14383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789438353.706590:0:14383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789438353.706591:0:14383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789438353.706592:0:14383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789438353.706593:0:14383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789438353.706594:0:14383:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789438353.706595:0:14383:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789438353.706596:0:14383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789438353.706597:0:14383:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789438353.706611:0:14383:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789438353.706620:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769736576:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789438353.706649:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438353.706665:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c5e6ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1789438353.709886:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769736576 00000100:00100000:3.0:1789438353.709898:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769736576 00000100:00100000:3.0:1789438353.709951:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789438353.709961:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+12:14383:x1876361769736576:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789438353.709990:0:14394:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789438353.710004:0:14394:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789438353.762385:0:14394:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789438353.762440:0:14394:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789438353.762593:0:14417:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789438353.762598:0:14417:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789438353.762619:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9991c2a55c00/0x7a8dd0fcbb925dc0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.762650:0:14417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991f3d62c00/0x7a8dd0fcbb925d8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925d88 expref: 12 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.762677:0:14417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9991c2a55c00/0x7a8dd0fcbb925dc0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.762754:0:14417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991f3d62c00/0x7a8dd0fcbb925d8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb925d88 expref: 12 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.762768:0:14417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9991f3d62c00/0x7a8dd0fcbb925d8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb925d88 expref: 12 pid: 14396 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438353.762782:0:14417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26eb100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14417:1876361769736704:0@lo:104: 00000100:00100000:3.0:1789438353.762837:0:14417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438353.762868:0:14417:0:(client.c:2716:ptlrpc_set_wait()) set ffff9990c1dc59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789438353.762941:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769736704 00000100:00100000:0.0:1789438353.762949:0:14385:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769736704 00000100:00100000:0.0:1789438353.762989:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789438353.763005:0:14385:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b3666e65-cb7a-452a-a637-b1a251df2a46+3:14417:x1876361769736704:12345-0@lo:104: 00010000:00010000:0.0:1789438353.763024:0:14385:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb925d88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb925d8f expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438353.763077:0:14385:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789438353.763082:0:14385:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b3666e65-cb7a-452a-a637-b1a251df2a46+3:14417:x1876361769736704:12345-0@lo:104: Request processed in 87us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438353.763089:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789438353.763231:0:14417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26eb100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14417:1876361769736704:0@lo:104: 00010000:00010000:2.0:1789438353.763248:0:14417:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9991c2a55c00/0x7a8dd0fcbb925dc0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.763740:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789438353.763747:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb925d88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb925d8f expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.763755:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55a00 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:3.0:1789438353.763759:0:14391:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb925d88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb925d8f expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.763767:0:14391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb925d88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb925d8f expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789438353.763774:0:14391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb925d88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb925d8f expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789438353.763780:0:14391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789438353.763812:0:14391:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb925d88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb925d8f expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.763831:0:14391:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789438353.763862:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb925d88 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb925d8f expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.763870:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991c2a55a00/0x7a8dd0fcbb925d88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb925d8f expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.763887:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438353.763889:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438353.763890:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438353.763910:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789438353.763921:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3666e65-cb7a-452a-a637-b1a251df2a46:3312:1876361769736832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789438353.763955:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438353.764023:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769736832 00000100:00100000:3.0:1789438353.764029:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769736832 00010000:00010000:3.0:1789438353.764048:0:14387:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991f3d62c00/0x7a8dd0fcbb925d8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb925d88 expref: 13 pid: 14396 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438353.764071:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789438353.764079:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3666e65-cb7a-452a-a637-b1a251df2a46+13:3312:x1876361769736832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789438353.764088:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438353.764093:0:14387:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991f3d62c00/0x7a8dd0fcbb925d8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb925d88 expref: 13 pid: 14396 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.764102:0:14387:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991f3d62c00/0x7a8dd0fcbb925d8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb925d88 expref: 13 pid: 14396 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.764115:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991f3d62c00/0x7a8dd0fcbb925d8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb925d88 expref: 13 pid: 14396 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.764133:0:14387:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9991c2a55c00/0x7a8dd0fcbb925dc0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.764142:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c2a55c00/0x7a8dd0fcbb925dc0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789438353.764155:0:14387:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001557535s 00010000:00010000:3.0:1789438353.764161:0:14387:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9991c2a55c00/0x7a8dd0fcbb925dc0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.764168:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9991c2a55c00/0x7a8dd0fcbb925dc0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.764176:0:14387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9991c2a55c00/0x7a8dd0fcbb925dc0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.764182:0:14387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9991c2a55c00/0x7a8dd0fcbb925dc0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.764188:0:14387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55c00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:3.0:1789438353.764192:0:14387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9991c2a55c00/0x7a8dd0fcbb925dc0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.764199:0:14387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9991c2a55c00/0x7a8dd0fcbb925dc0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.764212:0:14387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9991c2a55c00/0x7a8dd0fcbb925dc0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.764221:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789438353.764259:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3666e65-cb7a-452a-a637-b1a251df2a46+12:3312:x1876361769736832:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438353.764266:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789438353.764299:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3666e65-cb7a-452a-a637-b1a251df2a46:3312:1876361769736832:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789438353.764317:0:14417:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9991c2a55c00/0x7a8dd0fcbb925dc0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.764324:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9991c2a55c00/0x7a8dd0fcbb925dc0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438353.764329:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c2a55c00/0x7a8dd0fcbb925dc0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438353.791036:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+11:14383:x1876361769736576:12345-0@lo:253:mount.lustre.0 Request processed in 81068us (84377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438353.791051:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789438353.791292:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:14383:1876361769736576:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789438353.791308:0:14383:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789438353.791311:0:14383:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789438353.791313:0:14383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789438353.791314:0:14383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789438353.791315:0:14383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789438353.791316:0:14383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789438353.791317:0:14383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789438353.791318:0:14383:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789438353.791320:0:14383:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789438353.791321:0:14383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789438353.791322:0:14383:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789438353.791336:0:14383:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789438353.800642:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1789438353.800883:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789438353.804885:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789438353.805228:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789438353.805878:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789438353.806353:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789438353.807825:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1789438353.807985:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1789438353.810951:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789438353.812014:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789438353.812308:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789438353.812460:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1789438353.851459:0:14383:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1789438353.853145:0:14383:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789438353.853240:0:14439:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1789438353.853245:0:14439:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1789438353.854546:0:14440:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1789438353.854667:0:14440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789438353.856924:0:14440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789438353.856999:0:14440:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789438353.857003:0:14440:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1789438353.859299:0:14383:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789438353.859436:0:14383:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789438353.860211:0:14383:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789438353.860222:0:14383:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789438353.860375:0:14383:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789438353.864425:0:14383:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789438353.865434:0:14383:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789438353.865484:0:14383:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1789438353.866357:0:14383:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:2.0:1789438353.869163:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1789438353.876387:0:14383:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1789438353.923657:0:14383:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789438353.923694:0:14383:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaf4fc0d4b988 00100000:10000000:1.0:1789438353.923734:0:14383:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789438353.924936:0:14383:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789438353.924951:0:14383:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.109@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789438353.924962:0:14383:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789438353.924986:0:14383:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1789438354.358937:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789438354.749970:0:14433:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789438354.749980:0:14433:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789438354.750347:0:14433:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1789438354.750354:0:14433:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:0.0:1789438355.255332:0:14399:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789438355.255341:0:14399:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9991ff9b0800 from 6 10000000:01000000:0.0:1789438355.255346:0:14399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789438355.255390:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991f3d62a00/0x7a8dd0fcbb925dc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438355.255402:0:14399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991f3d62a00/0x7a8dd0fcbb925dc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438355.255414:0:14399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991f3d62a00/0x7a8dd0fcbb925dc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438355.255439:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff93bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769736960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789438355.255506:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438355.255589:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c7d92240 going to sleep for 11 seconds 00000100:00100000:3.0:1789438355.255797:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769736960 00000100:00100000:3.0:1789438355.255805:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769736960 00000100:00100000:3.0:1789438355.255865:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789438355.255874:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+11:14399:x1876361769736960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789438355.255885:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438355.255899:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c2a55a00/0x7a8dd0fcbb925dce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb925dc7 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438355.255921:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c2a55a00/0x7a8dd0fcbb925dce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925dc7 expref: 12 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438355.255931:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c2a55a00/0x7a8dd0fcbb925dce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925dc7 expref: 12 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438355.255939:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a55a00, rc 0) 00000100:00100000:3.0:1789438355.255974:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+12:14399:x1876361769736960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438355.255980:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789438355.256357:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff93bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769736960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789438355.256371:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991f3d62a00/0x7a8dd0fcbb925dc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925dce expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438355.256379:0:14399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991f3d62a00/0x7a8dd0fcbb925dc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb925dce expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438355.256428:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff93bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769737088:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789438355.256457:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438355.256486:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c7d92240 going to sleep for 11 seconds 00000100:00100000:3.0:1789438355.256821:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769737088 00000100:00100000:3.0:1789438355.256828:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769737088 00000100:00100000:3.0:1789438355.256868:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789438355.256876:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+12:14399:x1876361769737088:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789438355.256890:0:14394:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789438355.256908:0:14394:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789438355.256911:0:14394:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789438355.257001:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+12:14399:x1876361769737088:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 127us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438355.257013:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789438355.257236:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff93bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769737088:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789438355.257276:0:14399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789438355.257284:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991f3d62a00/0x7a8dd0fcbb925dc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925dce expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438355.257292:0:14399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991f3d62a00/0x7a8dd0fcbb925dc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925dce expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438355.383586:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789438355.771006:0:14433:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789438355.771016:0:14433:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789438355.771576:0:14433:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1789438355.771636:0:14433:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789438355.771669:0:14433:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:0.0:1789438356.408258:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438357.430937:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438358.457425:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789438358.849166:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789438358.849172:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789438358.849175:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789438358.849178:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789438358.849181:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789438358.849190:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789438358.849194:0:37:0:(import.c:65:import_set_state_nolock()) ffff9991fbad0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789438358.849209:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9991fbad0000 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:0.0:1789438358.849232:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9991ff938a80 x1876361769737344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789438358.849260:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789438358.849274:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3666e65-cb7a-452a-a637-b1a251df2a46:3311:1876361769737216:0@lo:400:kworker.0 00000100:00100000:0.0:1789438358.849336:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438358.849393:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769737216 00000100:00100000:0.0:1789438358.849400:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769737216 00000100:00100000:0.0:1789438358.849441:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789438358.849449:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+12:3311:x1876361769737216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438358.849496:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+12:3311:x1876361769737216:12345-0@lo:400:kworker.0 Request processed in 48us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438358.849503:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789438358.849538:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876361769737344:0@lo:38:kworker.0 00000100:00100000:0.0:1789438358.849567:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438358.849607:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3666e65-cb7a-452a-a637-b1a251df2a46:3311:1876361769737216:0@lo:400:kworker.0 00000100:00100000:0.0:1789438358.849969:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769737344 00000100:00100000:0.0:1789438358.849974:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769737344 00000100:00100000:0.0:1789438358.849998:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789438358.850002:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1876361769737344:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789438358.850023:0:14403:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 411 last 0 00000020:00000080:0.0:1789438358.850057:0:14403:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x7a8dd0fcbb925dd5 00000004:00100000:0.0:1789438358.850071:0:14403:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789438358.850208:0:14403:0:(import.c:65:import_set_state_nolock()) ffff9991c80fe000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789438358.850253:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876361769737344:12345-0@lo:38:kworker.0 Request processed in 249us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438358.850260:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789438358.850294:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9991ff938a80 x1876361769737344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789438368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789438358.850307:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789438358.850314:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789438358.850319:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789438358.850321:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9991fbad0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789438358.850327:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876361769737344:0@lo:38:kworker.0 00000001:02000400:0.0:1789438358.899098:0:14682:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg609-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789438359.479176:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438360.509878:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438361.527263:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789438362.009086:0:14835:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea9e3ed50 20000000:00000080:0.0:1789438362.009102:0:14835:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9991fc26bc00 uarg=0000000000000000 20000000:01000000:0.0:1789438362.009134:0:14835:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789438362.009140:0:14835:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789438362.009144:0:14835:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789438362.012056:0:14836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1789438362.012222:0:14835:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789438362.027101:0:14835:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789438362.027242:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9991c2a54000/0x7a8dd0fcbb925ddc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438362.027395:0:14835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991ff9dac00/0x7a8dd0fcbb925d9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925d96 expref: 11 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438362.027403:0:14835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9991c2a54000/0x7a8dd0fcbb925ddc lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438362.027445:0:14835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991ff9dac00/0x7a8dd0fcbb925d9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb925d96 expref: 11 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438362.027459:0:14835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9991ff9dac00/0x7a8dd0fcbb925d9d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb925d96 expref: 11 pid: 14395 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438362.027474:0:14835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26eb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14835:1876361769737472:0@lo:104: 00000100:00100000:3.0:1789438362.027535:0:14835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438362.027626:0:14835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9990c1dc5780 going to sleep for 11 seconds 00000100:00100000:0.0:1789438362.027696:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769737472 00000100:00100000:0.0:1789438362.027703:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769737472 00000100:00100000:0.0:1789438362.027890:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789438362.027899:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3666e65-cb7a-452a-a637-b1a251df2a46+3:14835:x1876361769737472:12345-0@lo:104: 00010000:00010000:0.0:1789438362.027911:0:14386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9991c2a54c00/0x7a8dd0fcbb925d96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb925d9d expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438362.028162:0:14386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789438362.028168:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3666e65-cb7a-452a-a637-b1a251df2a46+3:14835:x1876361769737472:12345-0@lo:104: Request processed in 271us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438362.028182:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789438362.028264:0:14835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26eb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14835:1876361769737472:0@lo:104: 00010000:00010000:2.0:1789438362.028333:0:14835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9991c2a54000/0x7a8dd0fcbb925ddc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438362.032390:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789438362.032403:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991c2a54c00/0x7a8dd0fcbb925d96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb925d9d expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438362.032415:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54c00 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:0.0:1789438362.032419:0:14390:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991c2a54c00/0x7a8dd0fcbb925d96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb925d9d expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438362.032429:0:14390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991c2a54c00/0x7a8dd0fcbb925d96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb925d9d expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789438362.032436:0:14390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991c2a54c00/0x7a8dd0fcbb925d96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb925d9d expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789438362.032441:0:14390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789438362.032486:0:14390:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991c2a54c00/0x7a8dd0fcbb925d96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb925d9d expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438362.032493:0:14390:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789438362.032582:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1789438362.033596:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991c2a54c00/0x7a8dd0fcbb925d96 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb925d9d expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438362.033606:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991c2a54c00/0x7a8dd0fcbb925d96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb925d9d expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438362.033643:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438362.033646:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438362.033648:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438362.035486:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3666e65-cb7a-452a-a637-b1a251df2a46:3310:1876361769737600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789438362.035553:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438362.035649:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769737600 00000100:00100000:3.0:1789438362.035657:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769737600 00010000:00010000:3.0:1789438362.035702:0:14387:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991ff9dac00/0x7a8dd0fcbb925d9d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb925d96 expref: 12 pid: 14395 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438362.035760:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789438362.035768:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3666e65-cb7a-452a-a637-b1a251df2a46+12:3310:x1876361769737600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789438362.035780:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438362.035796:0:14387:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991ff9dac00/0x7a8dd0fcbb925d9d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb925d96 expref: 12 pid: 14395 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438362.035809:0:14387:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991ff9dac00/0x7a8dd0fcbb925d9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb925d96 expref: 12 pid: 14395 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438362.035824:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991ff9dac00/0x7a8dd0fcbb925d9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb925d96 expref: 12 pid: 14395 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438362.035842:0:14387:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9991c2a54000/0x7a8dd0fcbb925ddc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438362.035861:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c2a54000/0x7a8dd0fcbb925ddc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438362.035876:0:14387:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9991c2a54000/0x7a8dd0fcbb925ddc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438362.035884:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9991c2a54000/0x7a8dd0fcbb925ddc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438362.035892:0:14387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9991c2a54000/0x7a8dd0fcbb925ddc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438362.035899:0:14387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9991c2a54000/0x7a8dd0fcbb925ddc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438362.035905:0:14387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54000 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:3.0:1789438362.035909:0:14387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9991c2a54000/0x7a8dd0fcbb925ddc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438362.035918:0:14387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9991c2a54000/0x7a8dd0fcbb925ddc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438362.036061:0:14387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9991c2a54000/0x7a8dd0fcbb925ddc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438362.036073:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789438362.036126:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3666e65-cb7a-452a-a637-b1a251df2a46+11:3310:x1876361769737600:12345-0@lo:103:ldlm_bl.0 Request processed in 358us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438362.036135:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789438362.036295:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3666e65-cb7a-452a-a637-b1a251df2a46:3310:1876361769737600:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789438362.036892:0:14835:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9991c2a54000/0x7a8dd0fcbb925ddc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438362.036906:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9991c2a54000/0x7a8dd0fcbb925ddc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438362.036913:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c2a54000/0x7a8dd0fcbb925ddc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438362.552912:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438363.576318:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789438363.833238:0:14399:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789438363.833245:0:14399:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9991ff9b0800 from 10 10000000:01000000:0.0:1789438363.833250:0:14399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789438363.833302:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991f3d62000/0x7a8dd0fcbb925de3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438363.833313:0:14399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991f3d62000/0x7a8dd0fcbb925de3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438363.833324:0:14399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991f3d62000/0x7a8dd0fcbb925de3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438363.833348:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff93b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769737728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789438363.833411:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438363.833458:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d073cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789438363.833513:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769737728 00000100:00100000:2.0:1789438363.833520:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769737728 00000100:00100000:2.0:1789438363.833570:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789438363.833589:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+11:14399:x1876361769737728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789438363.833601:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438363.833614:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c69e0a00/0x7a8dd0fcbb925dea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb925de3 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438363.833634:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c69e0a00/0x7a8dd0fcbb925dea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925de3 expref: 12 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438363.833646:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c69e0a00/0x7a8dd0fcbb925dea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925de3 expref: 12 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438363.833668:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c69e0a00, rc 0) 00000100:00100000:2.0:1789438363.833722:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+12:14399:x1876361769737728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438363.833729:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789438363.834123:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff93b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769737728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789438363.834138:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991f3d62000/0x7a8dd0fcbb925de3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925dea expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438363.834147:0:14399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991f3d62000/0x7a8dd0fcbb925de3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb925dea expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438363.834214:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff93b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769737856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789438363.834242:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438363.834273:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d073cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789438363.835735:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769737856 00000100:00100000:2.0:1789438363.835745:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769737856 00000100:00100000:2.0:1789438363.835788:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789438363.835796:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+12:14399:x1876361769737856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789438363.836212:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+12:14399:x1876361769737856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 415us (1968us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438363.836220:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789438363.837440:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff93b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769737856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789438363.837488:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff93b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769737984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789438363.837538:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438363.837574:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d073cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789438363.837685:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769737984 00000100:00100000:2.0:1789438363.837696:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769737984 00000100:00100000:2.0:1789438363.838030:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789438363.838039:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+12:14399:x1876361769737984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789438363.838207:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+12:14399:x1876361769737984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438363.838215:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789438363.840778:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff93b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769737984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789438363.843704:0:14899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789438363.846461:0:14399:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789438363.846494:0:14399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789438363.846505:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991f3d62000/0x7a8dd0fcbb925de3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925dea expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438363.846517:0:14399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991f3d62000/0x7a8dd0fcbb925de3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925dea expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789438363.958964:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789438363.958974:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789438363.958977:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789438363.958979:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789438363.959155:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789438363.959174:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769738112:0@lo:400:kworker.0 00000100:00100000:3.0:1789438363.959247:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438363.959475:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769738112 00000100:00100000:2.0:1789438363.959483:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769738112 00000100:00100000:2.0:1789438363.959541:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789438363.959550:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769738112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438363.959661:0:3308:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789438353/real 1789438353] req@ffff9991faab7b80 x1876361769734656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789438363 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789438363.959682:0:3308:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9991faab7b80 x1876361769734656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789438363 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789438363.959692:0:3308:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789438353/real 1789438353] req@ffff9991ff939c00 x1876361769734528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789438363 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789438363.959734:0:3308:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9991ff939c00 x1876361769734528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789438363 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789438363.959746:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9991de19a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789438363.959758:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789438363.959762:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876361769734656:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789438363.959767:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9991ffafb800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789438363.959772:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789438363.959775:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876361769734528:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789438363.959797:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789438363.959801:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789438363.959803:0:36:0:(import.c:65:import_set_state_nolock()) ffff9991ffafb800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789438363.959807:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 405 00000100:00080000:1.0:1789438363.959812:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789438363.959819:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9991ffafb800 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:1.0:1789438363.959839:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9991faab7b80 x1876361769738240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789438363.959864:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789438363.959867:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789438363.959869:0:36:0:(import.c:65:import_set_state_nolock()) ffff9991de19a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789438363.959872:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 405 00000100:00080000:1.0:1789438363.959874:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789438363.959879:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9991de19a800 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:1.0:1789438363.959891:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9991faab6680 x1876361769738368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789438363.959918:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876361769738240:0@lo:8:kworker.0 00000400:00000100:1.0:1789438363.959946:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876361769738240 offset 0 length 520: 4 00000100:00100000:1.0:1789438363.959967:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876361769738368:0@lo:8:kworker.0 00000400:00000100:1.0:1789438363.959986:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876361769738368 offset 0 length 520: 4 00000100:00100000:2.0:1789438363.960442:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769738112:12345-0@lo:400:kworker.0 Request processed in 892us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438363.960450:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789438363.963914:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9991faab5880 x1876361769738112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438363.963944:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769738112:0@lo:400:kworker.0 00010000:00010000:0.0:1789438364.598968:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438365.623702:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789438366.009120:0:14433:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789438366.649535:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789438367.605990:0:15083:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789438367.605994:0:15083:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1789438367.606125:0:15083:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9991e0122000 00000020:01000004:1.0:1789438367.606139:0:15083:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789438367.606149:0:15083:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789438367.606160:0:15083:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9991e1e53380) 00000020:00000080:1.0:1789438367.606174:0:15083:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789438367.647870:0:15083:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789438367.648172:0:15083:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789438367.650506:0:15083:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789438367.650957:0:15083:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1789438367.651157:0:15083:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1789438367.651492:0:15083:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 251: rc = 0 00100000:10000000:0.0:1789438367.653699:0:15083:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 251: rc = 0 00100000:10000000:0.0:1789438367.653935:0:15083:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 251: rc = 0 00100000:10000000:0.0:1789438367.656148:0:15083:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 745: rc = 0 00100000:10000000:0.0:1789438367.656372:0:15083:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 745: rc = 0 00100000:10000000:2.0:1789438367.657693:0:15083:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 745: rc = 0 00100000:10000000:2.0:1789438367.658153:0:15083:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 745: rc = 0 00100000:10000000:2.0:1789438367.658399:0:15083:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 745: rc = 0 00100000:10000000:2.0:1789438367.659276:0:15083:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 745: rc = 0 00000020:00000080:2.0:1789438367.660167:0:15083:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789438367.660178:0:15083:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789438367.660187:0:15083:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7a8dd0fcbb925df8 00000020:01000004:2.0:1789438367.660195:0:15083:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789438367.660215:0:15083:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.109@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789438367.660218:0:15083:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789438367.660223:0:15083:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789438367.660227:0:15083:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789438367.660238:0:15083:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9991ff998000) 00000020:00000080:2.0:1789438367.660248:0:15083:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1789438367.663609:0:15083:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789438367.664750:0:15083:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789438367.664757:0:15083:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789438367.674103:0:15083:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789438367.674122:0:15083:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789438367.674602:0:15083:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789438367.674610:0:15083:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00010000:00010000:0.0:1789438367.675493:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438367.676945:0:15083:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789438367.677155:0:15083:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789438367.677161:0:15083:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789438367.678684:0:15083:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789438367.678698:0:15083:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789438367.724066:0:15083:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789438367.724291:0:15083:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789438367.724297:0:15083:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789438367.726586:0:15083:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789438367.726612:0:15083:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789438367.728006:0:15083:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789438367.728017:0:15083:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789438367.734181:0:15083:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789438367.734378:0:15083:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789438367.734385:0:15083:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789438367.736005:0:15083:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789438367.736014:0:15083:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789438367.789541:0:15083:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789438367.789785:0:15083:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789438367.789791:0:15083:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789438367.794584:0:15083:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789438367.794602:0:15083:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789438367.795825:0:15083:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789438367.795851:0:15083:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789438367.795859:0:15083:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.109@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789438367.811446:0:15083:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.109@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789438367.811485:0:15083:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.109@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1789438367.811489:0:15083:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789438367.811491:0:15083:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789438367.811492:0:15083:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789438367.811494:0:15083:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789438367.811495:0:15083:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789438367.811496:0:15083:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789438367.811498:0:15083:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789438367.811500:0:15083:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789438367.811501:0:15083:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789438367.811505:0:15083:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1789438367.811507:0:15083:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789438367.811508:0:15083:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789438367.811509:0:15083:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789438367.811510:0:15083:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789438367.811511:0:15083:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789438367.811512:0:15083:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789438367.811513:0:15083:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789438367.811514:0:15083:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789438367.811515:0:15083:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789438367.811540:0:15083:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789438367.811560:0:15083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769738496:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789438367.811626:0:15083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438367.811936:0:15083:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c7d92cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789438367.811987:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769738496 00000100:00100000:0.0:1789438367.811995:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769738496 00000100:00100000:0.0:1789438367.812045:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789438367.812054:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+12:15083:x1876361769738496:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789438367.812094:0:14396:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789438367.812097:0:14396:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789438367.812101:0:14396:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789438367.829823:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+12:15083:x1876361769738496:12345-0@lo:253:mount.lustre.0 Request processed in 17762us (18187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438367.829838:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789438367.830013:0:15083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769738496:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789438367.830028:0:15083:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789438367.830032:0:15083:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789438367.830033:0:15083:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789438367.830034:0:15083:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789438367.830035:0:15083:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789438367.830036:0:15083:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789438367.830038:0:15083:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789438367.830039:0:15083:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789438367.830041:0:15083:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789438367.830043:0:15083:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789438367.830064:0:15083:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9991e0122000 from lustre-OST0000 10000000:01000000:2.0:1789438367.830095:0:15083:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789438367.830098:0:15083:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789438367.830104:0:15083:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9991ffba19c0 local copy 00010000:00010000:2.0:1789438367.830114:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991f3d62800/0x7a8dd0fcbb925cee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925cf5 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438367.830322:0:15083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769738624:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789438367.830361:0:15083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438367.830403:0:15083:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c7d92a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789438367.830749:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769738624 00000100:00100000:1.0:1789438367.830756:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769738624 00000100:00100000:1.0:1789438367.830793:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789438367.830801:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+12:15083:x1876361769738624:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789438367.831240:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+12:15083:x1876361769738624:12345-0@lo:501:mount.lustre.0 Request processed in 440us (877us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789438367.831248:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789438367.831307:0:15083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769738624:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789438367.831324:0:15083:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789438367.831465:0:15083:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789438367.831473:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991f3d62800/0x7a8dd0fcbb925cee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925cf5 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438367.831483:0:15083:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991f3d62800/0x7a8dd0fcbb925cee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925cf5 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789438367.831506:0:15083:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9991e0122000 10000000:01000000:3.0:1789438367.831510:0:15083:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789438367.831777:0:15083:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9991ffba19c0 10000000:01000000:3.0:1789438367.831782:0:15083:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789438367.831786:0:15083:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9991ffba19c0 from 1 10000000:01000000:3.0:1789438367.831788:0:15083:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789438367.831818:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c2a55c00/0x7a8dd0fcbb925e06 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438367.831826:0:15083:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991c2a55c00/0x7a8dd0fcbb925e06 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438367.831836:0:15083:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991c2a55c00/0x7a8dd0fcbb925e06 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438367.832187:0:15083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769738752:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789438367.832235:0:15083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438367.832325:0:15083:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fa9a9600 going to sleep for 11 seconds 00000100:00100000:2.0:1789438367.832374:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769738752 00000100:00100000:2.0:1789438367.832381:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769738752 00000100:00100000:2.0:1789438367.832464:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789438367.832472:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+12:15083:x1876361769738752:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789438367.832482:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438367.832497:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c69e0400/0x7a8dd0fcbb925e0d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb925e06 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438367.832520:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c69e0400/0x7a8dd0fcbb925e0d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925e06 expref: 13 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438367.832555:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c69e0400/0x7a8dd0fcbb925e0d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925e06 expref: 13 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438367.832572:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c69e0400, rc 0) 00000100:00100000:2.0:1789438367.832623:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+13:15083:x1876361769738752:12345-0@lo:101:mount.lustre.0 Request processed in 152us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438367.832629:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789438367.832742:0:15083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769738752:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789438367.832764:0:15083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991c2a55c00/0x7a8dd0fcbb925e06 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925e0d expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438367.832773:0:15083:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991c2a55c00/0x7a8dd0fcbb925e06 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb925e0d expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789438367.832790:0:15083:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789438367.832799:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c2a55c00/0x7a8dd0fcbb925e06 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925e0d expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438367.832805:0:15083:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991c2a55c00/0x7a8dd0fcbb925e06 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925e0d expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789438367.832812:0:15083:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789438367.832815:0:15083:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789438367.832819:0:15083:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789438367.832821:0:15083:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789438367.832837:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c2a55600/0x7a8dd0fcbb925e14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438367.832855:0:15083:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991c2a55600/0x7a8dd0fcbb925e14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438367.832863:0:15083:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991c2a55600/0x7a8dd0fcbb925e14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438367.832876:0:15083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769738880:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789438367.832901:0:15083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438367.833383:0:15083:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fa9a9600 going to sleep for 11 seconds 00000100:00100000:0.0:1789438367.833484:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769738880 00000100:00100000:0.0:1789438367.833490:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769738880 00000100:00100000:0.0:1789438367.833529:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789438367.833537:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+13:15083:x1876361769738880:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789438367.833545:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438367.833555:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991f3d62200/0x7a8dd0fcbb925e1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb925e14 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438367.833581:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991f3d62200/0x7a8dd0fcbb925e1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925e14 expref: 14 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438367.833590:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991f3d62200/0x7a8dd0fcbb925e1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925e14 expref: 14 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438367.833776:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d62200, rc 0) 00000100:00100000:0.0:1789438367.833814:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+14:15083:x1876361769738880:12345-0@lo:101:mount.lustre.0 Request processed in 278us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438367.833829:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789438367.834069:0:15083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769738880:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789438367.834081:0:15083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991c2a55600/0x7a8dd0fcbb925e14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925e1b expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438367.834089:0:15083:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991c2a55600/0x7a8dd0fcbb925e14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb925e1b expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789438367.835072:0:15083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789438367.836309:0:15083:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789438367.837015:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789438367.837067:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789438367.837102:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789438367.837150:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789438367.837183:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789438367.837214:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789438367.837279:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789438367.837287:0:15083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789438367.837370:0:15083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769739008:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789438367.837429:0:15083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438367.837479:0:15083:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fa9a93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789438367.837588:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769739008 00000100:00100000:1.0:1789438367.837604:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769739008 00000100:00100000:1.0:1789438367.837661:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789438367.837679:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+14:15083:x1876361769739008:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789438367.838025:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+14:15083:x1876361769739008:12345-0@lo:501:mount.lustre.0 Request processed in 347us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438367.838033:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789438367.838075:0:15083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769739008:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789438367.838104:0:15083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769739136:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789438367.838137:0:15083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438367.838156:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769739136 00000100:00100000:1.0:1789438367.838160:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769739136 00000100:00100000:1.0:1789438367.838175:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789438367.838180:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+14:15083:x1876361769739136:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789438367.838424:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+14:15083:x1876361769739136:12345-0@lo:503:mount.lustre.0 Request processed in 244us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438367.838431:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789438367.838456:0:15083:0:(client.c:2716:ptlrpc_set_wait()) set ffff9990c2219780 going to sleep for 11 seconds 00000100:00100000:1.0:1789438367.838466:0:15083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769739136:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789438367.839090:0:15083:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789438367.839155:0:15083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769739264:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789438367.839198:0:15083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438367.839228:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769739264 00000100:00100000:1.0:1789438367.839232:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769739264 00000100:00100000:1.0:1789438367.839252:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789438367.839258:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+14:15083:x1876361769739264:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789438367.839416:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+14:15083:x1876361769739264:12345-0@lo:502:mount.lustre.0 Request processed in 157us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438367.839430:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789438367.839466:0:15083:0:(client.c:2716:ptlrpc_set_wait()) set ffff9990c2219780 going to sleep for 11 seconds 00000100:00100000:1.0:1789438367.839482:0:15083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769739264:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789438367.839728:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789438367.839775:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789438367.839809:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789438367.839855:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789438367.839892:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789438367.839939:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789438367.839988:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789438367.840024:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789438367.840058:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1789438367.840107:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1789438367.840142:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1789438367.840190:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1789438367.840218:0:15083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769739392:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789438367.840261:0:15083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438367.840294:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769739392 00000100:00100000:1.0:1789438367.840299:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769739392 00000100:00100000:1.0:1789438367.840320:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789438367.840326:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+14:15083:x1876361769739392:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789438367.841070:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+14:15083:x1876361769739392:12345-0@lo:502:mount.lustre.0 Request processed in 740us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438367.841079:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789438367.841126:0:15083:0:(client.c:2716:ptlrpc_set_wait()) set ffff9990c2219780 going to sleep for 11 seconds 00000100:00100000:1.0:1789438367.841143:0:15083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769739392:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789438367.841218:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1789438367.841235:0:15083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1789438367.843037:0:15098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789438367.843047:0:15098:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1789438367.843053:0:15098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789438367.843056:0:15098:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789438367.843061:0:15098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789438367.843075:0:15098:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9991ff99cd40) 00000020:00000080:2.0:1789438367.843095:0:15098:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789438367.843104:0:15098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789438367.843180:0:15098:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9991e0122000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789438367.843187:0:15098:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789438367.843194:0:15098:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7a8dd0fcbb925e29 00010000:00010000:2.0:1789438367.850508:0:15098:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1789438367.851171:0:15098:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1789438367.853424:0:15098:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1789438367.855000:0:15098:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789438367.855010:0:15098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789438367.855015:0:15098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789438367.855017:0:15098:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789438367.855021:0:15098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789438367.855023:0:15098:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1789438367.855025:0:15098:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789438367.855026:0:15098:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789438367.855027:0:15098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789438367.855030:0:15098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789438367.855031:0:15098:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789438367.855040:0:15098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789438367.855043:0:15098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789438367.855044:0:15098:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789438367.855047:0:15098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789438367.855049:0:15098:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789438367.855051:0:15098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789438367.855053:0:15098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789438367.855054:0:15098:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789438367.855056:0:15098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789438367.855058:0:15098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789438367.855059:0:15098:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789438367.855062:0:15098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789438367.855104:0:15098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789438367.855107:0:15098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789438367.855108:0:15098:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789438367.855111:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1789438367.855297:0:15083:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1789438367.855322:0:15083:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789438367.855341:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c2a55600/0x7a8dd0fcbb925e14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925e1b expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438367.855353:0:15083:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991c2a55600/0x7a8dd0fcbb925e14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925e1b expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789438367.855361:0:15083:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9991e0122000 from 1 10000000:01000000:1.0:1789438367.855363:0:15083:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789438367.855394:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9dae00/0x7a8dd0fcbb925e30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438367.855402:0:15083:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991ff9dae00/0x7a8dd0fcbb925e30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438367.855412:0:15083:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991ff9dae00/0x7a8dd0fcbb925e30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438367.855433:0:15083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769739520:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789438367.855487:0:15083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438367.855535:0:15083:0:(client.c:2716:ptlrpc_set_wait()) set ffff9990c2219780 going to sleep for 11 seconds 00000100:00100000:0.0:1789438367.855754:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769739520 00000100:00100000:0.0:1789438367.855760:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769739520 00000100:00100000:0.0:1789438367.855800:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789438367.855808:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+14:15083:x1876361769739520:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789438367.855820:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438367.855831:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991f3d63400/0x7a8dd0fcbb925e37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb925e30 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438367.855853:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991f3d63400/0x7a8dd0fcbb925e37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925e30 expref: 15 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438367.855862:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991f3d63400/0x7a8dd0fcbb925e37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925e30 expref: 15 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438367.855870:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63400, rc 0) 00000100:00100000:0.0:1789438367.855903:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+15:15083:x1876361769739520:12345-0@lo:101:mount.lustre.0 Request processed in 96us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438367.855910:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789438367.856041:0:15083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769739520:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789438367.856054:0:15083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991ff9dae00/0x7a8dd0fcbb925e30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925e37 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438367.856062:0:15083:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991ff9dae00/0x7a8dd0fcbb925e30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb925e37 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789438367.856537:0:15083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789438367.857159:0:15083:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789438367.857371:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789438367.857414:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789438367.857477:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789438367.857485:0:15083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789438367.857550:0:15083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769739648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789438367.858235:0:15083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438367.858284:0:15083:0:(client.c:2716:ptlrpc_set_wait()) set ffff9990c2219780 going to sleep for 11 seconds 00000100:00100000:0.0:1789438367.858492:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769739648 00000100:00100000:0.0:1789438367.858500:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769739648 00000100:00100000:0.0:1789438367.858550:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789438367.858559:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+15:15083:x1876361769739648:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789438367.859107:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+15:15083:x1876361769739648:12345-0@lo:501:mount.lustre.0 Request processed in 547us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438367.859117:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789438367.859276:0:15083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769739648:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789438367.859315:0:15083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff93b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769739776:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789438367.859357:0:15083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438367.859393:0:15083:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c7e43c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789438367.859480:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769739776 00000100:00100000:1.0:1789438367.859486:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769739776 00000100:00100000:1.0:1789438367.859523:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789438367.859530:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+15:15083:x1876361769739776:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789438367.860024:0:15083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff93b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769739776:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789438367.860765:0:15083:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789438367.860835:0:15083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff93b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769739904:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789438367.860885:0:15083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438367.860923:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769739904 00000100:00100000:0.0:1789438367.860928:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769739904 00000100:00100000:1.0:1789438367.861102:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+16:15083:x1876361769739776:12345-0@lo:503:mount.lustre.0 Request processed in 1570us (1742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438367.861110:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789438367.861405:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789438367.861414:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+15:15083:x1876361769739904:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789438367.861642:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+15:15083:x1876361769739904:12345-0@lo:502:mount.lustre.0 Request processed in 220us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438367.861650:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789438367.863069:0:15083:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c7e43c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789438367.863100:0:15083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff93b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769739904:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789438367.863391:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789438367.863448:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789438367.863498:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789438367.863552:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789438367.863586:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789438367.863677:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789438367.863740:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789438367.863777:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1789438367.863814:0:15083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769740032:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789438367.863884:0:15083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438367.870695:0:15083:0:(client.c:2716:ptlrpc_set_wait()) set ffff9990c2219480 going to sleep for 11 seconds 00000100:00100000:3.0:1789438367.871070:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769740032 00000100:00100000:3.0:1789438367.871080:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769740032 00000100:00100000:3.0:1789438367.871127:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789438367.871136:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+15:15083:x1876361769740032:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789438367.871410:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+15:15083:x1876361769740032:12345-0@lo:502:mount.lustre.0 Request processed in 273us (7525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438367.871419:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789438367.871547:0:15083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769740032:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789438367.871974:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789438367.871990:0:15083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1789438367.872974:0:15102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789438367.872985:0:15102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438367.872987:0:15102:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789438367.872994:0:15102:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9991e0122000 00000020:00000080:1.0:1789438367.872996:0:15102:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789438367.873003:0:15102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789438367.873005:0:15102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438367.873006:0:15102:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789438367.873009:0:15102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789438367.873011:0:15102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438367.873012:0:15102:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789438367.873015:0:15102:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9991e0122000 00000020:00000080:1.0:1789438367.873017:0:15102:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789438367.873071:0:15102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789438367.873074:0:15102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438367.873075:0:15102:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789438367.873078:0:15102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789438367.873080:0:15102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438367.873081:0:15102:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789438367.873084:0:15102:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9991e0122000 00000020:00000080:1.0:1789438367.873086:0:15102:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789438367.873117:0:15102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789438367.873120:0:15102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789438367.873122:0:15102:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789438367.873124:0:15102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1789438367.881816:0:15083:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789438367.881860:0:15083:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789438367.881879:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991ff9dae00/0x7a8dd0fcbb925e30 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925e37 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438367.881902:0:15083:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991ff9dae00/0x7a8dd0fcbb925e30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925e37 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789438367.882415:0:15083:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789438367.882419:0:15083:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9991e0122000 10000000:01000000:3.0:1789438367.882423:0:15083:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9991e0122000 10000000:01000000:3.0:1789438367.882427:0:15083:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789438367.882434:0:15083:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9991e0122000 from 1 10000000:01000000:3.0:1789438367.882437:0:15083:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789438367.882472:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c2a55400/0x7a8dd0fcbb925e3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438367.882482:0:15083:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991c2a55400/0x7a8dd0fcbb925e3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438367.882493:0:15083:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991c2a55400/0x7a8dd0fcbb925e3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438367.882747:0:15083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769740160:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789438367.882810:0:15083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438367.882848:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769740160 00000100:00100000:3.0:1789438367.882855:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769740160 00000100:00100000:3.0:1789438367.882900:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789438367.882909:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+15:15083:x1876361769740160:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789438367.882921:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1789438367.883755:0:15083:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991ff88d900 going to sleep for 11 seconds 00010000:00010000:3.0:1789438367.883806:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c2a55200/0x7a8dd0fcbb925e45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb925e3e expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438367.883844:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c2a55200/0x7a8dd0fcbb925e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925e3e expref: 16 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438367.883856:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c2a55200/0x7a8dd0fcbb925e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925e3e expref: 16 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438367.883866:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a55200, rc 0) 00000100:00100000:3.0:1789438367.884025:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+16:15083:x1876361769740160:12345-0@lo:101:mount.lustre.0 Request processed in 1116us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438367.884033:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789438367.893829:0:15083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769740160:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789438367.893859:0:15083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991c2a55400/0x7a8dd0fcbb925e3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925e45 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438367.893874:0:15083:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991c2a55400/0x7a8dd0fcbb925e3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb925e45 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789438367.897814:0:15083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1789438367.900533:0:15083:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789438367.901168:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789438367.901218:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1789438367.901253:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1789438367.901299:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1789438367.901335:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1789438367.901397:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1789438367.901434:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1789438367.901467:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1789438367.901527:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1789438367.901567:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1789438367.903810:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1789438367.904054:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1789438367.904109:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1789438367.904151:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1789438367.904212:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1789438367.904277:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1789438367.906327:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1789438367.906445:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1789438367.906487:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1789438367.906543:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1789438367.906856:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1789438367.906900:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1789438367.906952:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1789438367.907031:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1789438367.907074:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1789438367.907109:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1789438367.907157:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1789438367.907194:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1789438367.907281:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1789438367.907290:0:15083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1789438367.907401:0:15083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff93aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769740288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789438367.907464:0:15083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438367.907525:0:15083:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c7e439c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438367.908870:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769740288 00000100:00100000:3.0:1789438367.908881:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769740288 00000100:00100000:3.0:1789438367.909101:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789438367.909114:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+16:15083:x1876361769740288:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789438367.909652:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+16:15083:x1876361769740288:12345-0@lo:501:mount.lustre.0 Request processed in 540us (2185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438367.909662:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789438367.909789:0:15083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff93aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769740288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789438367.909836:0:15083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff93aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769740416:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789438367.909884:0:15083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438367.909912:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769740416 00000100:00100000:0.0:1789438367.909924:0:15083:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c7e439c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438367.910093:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769740416 00000100:00100000:3.0:1789438367.910125:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789438367.910133:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+16:15083:x1876361769740416:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789438367.915010:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+16:15083:x1876361769740416:12345-0@lo:503:mount.lustre.0 Request processed in 4869us (5117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438367.915025:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789438367.919403:0:15083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff93aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769740416:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789438367.920019:0:15083:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789438367.920097:0:15083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769740544:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789438367.920166:0:15083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438367.920213:0:15083:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fabaab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789438367.923268:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769740544 00000100:00100000:3.0:1789438367.923284:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769740544 00000100:00100000:3.0:1789438367.923367:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789438367.923377:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+16:15083:x1876361769740544:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789438367.923691:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+16:15083:x1876361769740544:12345-0@lo:502:mount.lustre.0 Request processed in 315us (3524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438367.923699:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789438367.924366:0:15083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769740544:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789438367.924660:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789438367.924744:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789438367.924783:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789438367.924849:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789438367.924883:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789438367.924948:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789438367.924988:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789438367.925022:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789438367.925086:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789438367.925127:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789438367.925163:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789438367.925213:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789438367.925248:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789438367.925284:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789438367.925335:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789438367.925372:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789438367.925407:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789438367.925456:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789438367.925494:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789438367.925546:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789438367.925595:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789438367.925648:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789438367.925683:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789438367.925758:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789438367.925792:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1789438367.925829:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1789438367.925875:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1789438367.925909:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1789438367.925940:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1789438367.925984:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1789438367.926017:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1789438367.926046:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1789438367.926076:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1789438367.926123:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1789438367.926158:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1789438367.926222:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1789438367.926257:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1789438367.926286:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1789438367.926331:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1789438367.926364:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1789438367.926410:0:15083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769740672:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789438367.926486:0:15083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438367.926534:0:15083:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fabaab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789438367.926799:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769740672 00000100:00100000:3.0:1789438367.926808:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769740672 00000100:00100000:3.0:1789438367.926851:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789438367.926861:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+16:15083:x1876361769740672:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789438367.927227:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+16:15083:x1876361769740672:12345-0@lo:502:mount.lustre.0 Request processed in 366us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438367.927235:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789438367.930787:0:15083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769740672:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789438367.932195:0:15083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1789438367.932218:0:15083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1789438367.938204:0:15107:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789438367.938222:0:15107:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9991ff99b380) 00000020:00000080:2.0:1789438367.938244:0:15107:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1789438367.938333:0:15107:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9991e0122000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789438367.938338:0:15107:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9991e0122000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789438367.938341:0:15107:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9991e0122000 3 00010000:00080000:2.0:1789438367.938371:0:15107:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9990c187e800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.109@tcp at head 00010000:00010000:2.0:1789438367.940311:0:15107:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1789438367.940503:0:15107:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789438367.940537:0:15107:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789438367.940549:0:15107:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x7a8dd0fcbb925e53 00000100:00080000:2.0:1789438367.940559:0:15107:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789438367.940569:0:15107:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9990c187e800 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:2.0:1789438367.940619:0:15107:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9991f3d2fb80 x1876361769740800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789438367.940655:0:15107:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789438367.941021:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789438367.941026:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789438367.941029:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789438367.941032:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789438367.941087:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876361769740928:0@lo:400:kworker.0 00000100:00100000:3.0:1789438367.941157:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438367.941210:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769740928 00000100:00100000:3.0:1789438367.941216:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769740928 00000100:00100000:3.0:1789438367.941254:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789438367.941263:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876361769740928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438367.941309:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876361769740928:12345-0@lo:400:kworker.0 Request processed in 48us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438367.941316:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789438367.941444:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9990c26e9c00 x1876361769740928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438367.941457:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876361769740928:0@lo:400:kworker.0 00000100:00100000:1.0:1789438367.943444:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1876361769740800:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789438367.943505:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1789438367.943776:0:15107:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:3.0:1789438367.946050:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769740800 00000100:00100000:3.0:1789438367.946061:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769740800 00000100:00100000:3.0:1789438367.946108:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789438367.946117:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3308:x1876361769740800:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789438367.946160:0:14402:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 420 last 0 00000020:00000080:3.0:1789438367.946198:0:14402:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x7a8dd0fcbb925e5a 00000004:00100000:3.0:1789438367.946212:0:14402:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789438367.946242:0:14402:0:(import.c:65:import_set_state_nolock()) ffff9991e011e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789438367.946316:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876361769740800:12345-0@lo:38:llog_process_th.0 Request processed in 199us (2810us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438367.946323:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789438367.946366:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9991f3d2fb80 x1876361769740800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789438377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438367.946377:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789438367.946385:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789438367.946391:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789438367.946396:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789438367.946398:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9990c187e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789438367.946403:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1876361769740800:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1789438367.946429:0:15083:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789438367.946458:0:15083:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789438367.946472:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c2a55400/0x7a8dd0fcbb925e3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925e45 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438367.946489:0:15083:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991c2a55400/0x7a8dd0fcbb925e3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925e45 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789438367.952119:0:15083:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789438367.952124:0:15083:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789438367.952126:0:15083:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789438367.952127:0:15083:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789438367.952128:0:15083:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789438367.952131:0:15083:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789438367.952133:0:15083:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789438367.952135:0:15083:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789438367.952136:0:15083:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789438367.952140:0:15083:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1789438367.952142:0:15083:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789438367.952144:0:15083:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789438367.952145:0:15083:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789438367.952146:0:15083:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789438367.952147:0:15083:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789438367.952148:0:15083:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789438367.952149:0:15083:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789438367.952151:0:15083:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789438367.952152:0:15083:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789438367.952178:0:15083:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789438367.952196:0:15083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769741056:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789438367.952263:0:15083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438367.952342:0:15083:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c5e00600 going to sleep for 11 seconds 00000100:00100000:2.0:1789438367.953699:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769741056 00000100:00100000:2.0:1789438367.953826:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769741056 00000100:00100000:1.0:1789438367.954029:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789438367.954040:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+16:15083:x1876361769741056:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789438367.954071:0:14396:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789438367.954084:0:14396:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789438367.973357:0:14396:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789438367.973371:0:14396:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789438367.973389:0:14417:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789438367.973393:0:14417:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789438367.973416:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9991c2a55800/0x7a8dd0fcbb925e61 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438367.973435:0:14417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991c2a55a00/0x7a8dd0fcbb925dce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925dc7 expref: 16 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438367.973455:0:14417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9991c2a55800/0x7a8dd0fcbb925e61 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438367.973490:0:14417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991c2a55a00/0x7a8dd0fcbb925dce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb925dc7 expref: 16 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438367.973502:0:14417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9991c2a55a00/0x7a8dd0fcbb925dce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb925dc7 expref: 16 pid: 14396 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438367.973616:0:14417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26e9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14417:1876361769741184:0@lo:104: 00000100:00100000:3.0:1789438367.973688:0:14417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438367.973793:0:14417:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c5e00780 going to sleep for 11 seconds 00000100:00100000:0.0:1789438367.979319:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+16:15083:x1876361769741056:12345-0@lo:253:mount.lustre.0 Request processed in 25274us (27048us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438367.979332:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789438367.979436:0:15083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15083:1876361769741056:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789438367.979450:0:15083:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789438367.979454:0:15083:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789438367.979455:0:15083:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789438367.979457:0:15083:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789438367.979458:0:15083:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789438367.979459:0:15083:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789438367.979460:0:15083:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789438367.979461:0:15083:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789438367.979463:0:15083:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789438367.979464:0:15083:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789438367.979477:0:15083:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789438367.982767:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769741184 00000100:00100000:0.0:1789438367.982781:0:14385:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769741184 00000100:00100000:0.0:1789438367.983003:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789438367.983013:0:14385:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b3666e65-cb7a-452a-a637-b1a251df2a46+3:14417:x1876361769741184:12345-0@lo:104: 00010000:00010000:0.0:1789438367.983044:0:14385:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9991f3d62a00/0x7a8dd0fcbb925dc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb925dce expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438367.983135:0:14385:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789438367.983142:0:14385:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b3666e65-cb7a-452a-a637-b1a251df2a46+3:14417:x1876361769741184:12345-0@lo:104: Request processed in 131us (9454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438367.983150:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789438367.983158:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789438367.983167:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991f3d62a00/0x7a8dd0fcbb925dc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb925dce expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438367.983176:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d62a00 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:2.0:1789438367.983181:0:14391:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991f3d62a00/0x7a8dd0fcbb925dc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb925dce expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438367.983190:0:14391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991f3d62a00/0x7a8dd0fcbb925dc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb925dce expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789438367.983204:0:14391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991f3d62a00/0x7a8dd0fcbb925dc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb925dce expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789438367.983210:0:14391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789438367.983251:0:14391:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991f3d62a00/0x7a8dd0fcbb925dc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb925dce expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438367.983257:0:14391:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789438367.983285:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991f3d62a00/0x7a8dd0fcbb925dc7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb925dce expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438367.983293:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991f3d62a00/0x7a8dd0fcbb925dc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb925dce expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438367.983310:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438367.983312:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438367.983313:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438367.983321:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789438367.983335:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3666e65-cb7a-452a-a637-b1a251df2a46:3311:1876361769741312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789438367.983371:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438367.983402:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769741312 00000100:00100000:0.0:1789438367.983408:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769741312 00010000:00010000:0.0:1789438367.983429:0:14389:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991c2a55a00/0x7a8dd0fcbb925dce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb925dc7 expref: 16 pid: 14396 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438367.983432:0:14417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26e9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14417:1876361769741184:0@lo:104: 00010000:00010000:2.0:1789438367.983458:0:14417:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9991c2a55800/0x7a8dd0fcbb925e61 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438367.983463:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789438367.983474:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3666e65-cb7a-452a-a637-b1a251df2a46+16:3311:x1876361769741312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789438367.983486:0:14389:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438367.983492:0:14389:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991c2a55a00/0x7a8dd0fcbb925dce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb925dc7 expref: 16 pid: 14396 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438367.983503:0:14389:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991c2a55a00/0x7a8dd0fcbb925dce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb925dc7 expref: 16 pid: 14396 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438367.983517:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c2a55a00/0x7a8dd0fcbb925dce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb925dc7 expref: 16 pid: 14396 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438367.983538:0:14389:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9991c2a55800/0x7a8dd0fcbb925e61 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438367.983547:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c2a55800/0x7a8dd0fcbb925e61 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789438367.983572:0:14389:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010179749s 00010000:00010000:0.0:1789438367.983577:0:14389:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9991c2a55800/0x7a8dd0fcbb925e61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438367.983584:0:14389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9991c2a55800/0x7a8dd0fcbb925e61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438367.983591:0:14389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9991c2a55800/0x7a8dd0fcbb925e61 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438367.983598:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9991c2a55800/0x7a8dd0fcbb925e61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438367.983604:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55800 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:0.0:1789438367.983613:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9991c2a55800/0x7a8dd0fcbb925e61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438367.983621:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9991c2a55800/0x7a8dd0fcbb925e61 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438367.983649:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9991c2a55800/0x7a8dd0fcbb925e61 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438367.983660:0:14389:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789438367.983798:0:14417:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9991c2a55800/0x7a8dd0fcbb925e61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438367.983806:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9991c2a55800/0x7a8dd0fcbb925e61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438367.983821:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c2a55800/0x7a8dd0fcbb925e61 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438367.984150:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3666e65-cb7a-452a-a637-b1a251df2a46+15:3311:x1876361769741312:12345-0@lo:103:ldlm_bl.0 Request processed in 676us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438367.984159:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789438367.984184:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3666e65-cb7a-452a-a637-b1a251df2a46:3311:1876361769741312:0@lo:103:ldlm_bl.0 00080000:10000000:3.0:1789438367.985920:0:15083:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789438367.988054:0:15083:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789438367.988367:0:15083:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789438367.989410:0:15083:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789438367.989653:0:15083:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789438367.991268:0:15083:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789438367.993130:0:15083:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789438368.047509:0:15083:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789438368.047527:0:15083:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789438368.047558:0:15083:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789438368.047622:0:15083:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.109@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789438368.047650:0:15083:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789438368.047670:0:15083:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1789438368.697616:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789438369.210348:0:14399:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789438369.210355:0:14399:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9991ff9b0800 from 7 10000000:01000000:0.0:1789438369.210360:0:14399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789438369.210403:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991f3d62e00/0x7a8dd0fcbb925e68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438369.210415:0:14399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991f3d62e00/0x7a8dd0fcbb925e68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438369.210425:0:14399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991f3d62e00/0x7a8dd0fcbb925e68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438369.210448:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff93a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769741440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789438369.210509:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438369.210658:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769741440 00000100:00100000:3.0:1789438369.210666:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769741440 00000100:00100000:0.0:1789438369.210730:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c6dbd180 going to sleep for 11 seconds 00000100:00100000:3.0:1789438369.219282:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789438369.219300:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+15:14399:x1876361769741440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789438369.219330:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438369.219349:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb925e6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb925e68 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438369.219376:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb925e6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925e68 expref: 16 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438369.219387:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb925e6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925e68 expref: 16 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438369.219396:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a54400, rc 0) 00000100:00100000:3.0:1789438369.219464:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+16:14399:x1876361769741440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (8954us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438369.219470:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789438369.219913:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff93a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769741440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789438369.219930:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991f3d62e00/0x7a8dd0fcbb925e68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925e6f expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438369.219940:0:14399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991f3d62e00/0x7a8dd0fcbb925e68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb925e6f expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438369.220010:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff93a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769741568:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789438369.220048:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438369.220073:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c6dbd180 going to sleep for 11 seconds 00000100:00100000:1.0:1789438369.220134:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769741568 00000100:00100000:1.0:1789438369.220146:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769741568 00000100:00100000:1.0:1789438369.220185:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789438369.220192:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+16:14399:x1876361769741568:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789438369.220206:0:14396:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789438369.220221:0:14396:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789438369.220224:0:14396:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1789438369.220299:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+16:14399:x1876361769741568:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438369.220306:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789438369.220337:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff93a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769741568:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789438369.220392:0:14399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789438369.220399:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991f3d62e00/0x7a8dd0fcbb925e68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925e6f expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438369.220407:0:14399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991f3d62e00/0x7a8dd0fcbb925e68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925e6f expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438369.719186:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438370.743172:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438371.769345:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438372.792840:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789438373.175316:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789438373.175323:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789438373.175326:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789438373.175329:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789438373.175387:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3666e65-cb7a-452a-a637-b1a251df2a46:3309:1876361769741696:0@lo:400:kworker.0 00000100:00100000:2.0:1789438373.175456:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438373.175497:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789438373.175502:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769741824:0@lo:400:kworker.0 00000100:00100000:2.0:1789438373.175524:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438373.175875:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769741952:0@lo:400:kworker.0 00000100:00100000:2.0:1789438373.175905:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438373.175933:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769741696 00000100:00100000:2.0:1789438373.175939:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769741696 00000100:00100000:2.0:1789438373.175975:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789438373.175983:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+16:3309:x1876361769741696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438373.176024:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+16:3309:x1876361769741696:12345-0@lo:400:kworker.0 Request processed in 42us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438373.176031:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789438373.176059:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769741824 00000100:00100000:2.0:1789438373.176069:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769741824 00000100:00100000:2.0:1789438373.176089:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769741952 00000100:00100000:2.0:1789438373.176092:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769741952 00000100:00100000:2.0:1789438373.176110:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789438373.176115:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769741824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438373.176143:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769741824:12345-0@lo:400:kworker.0 Request processed in 28us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438373.176149:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789438373.176159:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789438373.176165:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769741952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438373.176190:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769741952:12345-0@lo:400:kworker.0 Request processed in 26us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438373.176195:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789438373.176262:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991f3d2f800 x1876361769741952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438373.176275:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769741952:0@lo:400:kworker.0 00000100:00080000:3.0:1789438373.176436:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789438373.176827:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991f3d2dc00 x1876361769741824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438373.176839:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769741824:0@lo:400:kworker.0 00000100:00100000:2.0:1789438373.176849:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3666e65-cb7a-452a-a637-b1a251df2a46:3309:1876361769741696:0@lo:400:kworker.0 00010000:00010000:3.0:1789438373.830759:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789438374.553589:0:15451:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg609-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789438374.843481:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438375.866746:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789438376.252227:0:14433:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789438376.887973:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438377.913500:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438378.166824:0:3308:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789438363/real 1789438363] req@ffff9991faab7b80 x1876361769738240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789438378 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438378.166866:0:3308:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9991faab7b80 x1876361769738240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789438378 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438378.166877:0:3308:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789438363/real 1789438363] req@ffff9991faab6680 x1876361769738368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789438378 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438378.166889:0:3308:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9991faab6680 x1876361769738368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789438378 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789438378.166907:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9991ffafb800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789438378.166983:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789438378.166988:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876361769738240:0@lo:8:kworker.0 00000100:00080000:0.0:1789438378.166994:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9991de19a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789438378.169774:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789438378.169780:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789438378.169783:0:37:0:(import.c:65:import_set_state_nolock()) ffff9991ffafb800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789438378.169790:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 416 00000100:00080000:1.0:1789438378.169795:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789438378.169806:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9991ffafb800 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:1.0:1789438378.169826:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9991faab6d80 x1876361769742208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789438378.169981:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3666e65-cb7a-452a-a637-b1a251df2a46:3312:1876361769742080:0@lo:400:kworker.0 00000100:00100000:2.0:1789438378.170044:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438378.170107:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769742080 00000100:00100000:2.0:1789438378.170113:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769742080 00000100:00100000:2.0:1789438378.170160:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789438378.170168:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+16:3312:x1876361769742080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438378.170206:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+16:3312:x1876361769742080:12345-0@lo:400:kworker.0 Request processed in 39us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438378.170212:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789438378.170253:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3666e65-cb7a-452a-a637-b1a251df2a46:3312:1876361769742080:0@lo:400:kworker.0 00000100:00080000:1.0:1789438378.171222:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789438378.171237:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789438378.171240:0:37:0:(import.c:65:import_set_state_nolock()) ffff9991de19a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789438378.171245:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 416 00000100:00080000:1.0:1789438378.171249:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789438378.171256:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9991de19a800 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:1.0:1789438378.171278:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9991faab5180 x1876361769742336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789438378.171545:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769742464:0@lo:400:kworker.0 00000100:00100000:2.0:1789438378.171600:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438378.171630:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789438378.171636:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769742592:0@lo:400:kworker.0 00000100:00100000:2.0:1789438378.171654:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438378.171784:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769742464 00000100:00100000:3.0:1789438378.171790:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769742464 00000100:00100000:3.0:1789438378.171830:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769742592 00000100:00100000:3.0:1789438378.171833:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769742592 00000100:00100000:3.0:1789438378.171866:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789438378.171873:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769742464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438378.171913:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769742464:12345-0@lo:400:kworker.0 Request processed in 41us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438378.171920:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789438378.171940:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789438378.171945:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769742592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438378.171968:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876361769742592:12345-0@lo:400:kworker.0 Request processed in 23us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438378.171973:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789438378.171986:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789438378.172005:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991faab6a00 x1876361769742592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438378.172017:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876361769742592:0@lo:400:kworker.0 00010000:00080000:3.0:1789438378.172025:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991faab5c00 x1876361769742464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438378.172033:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769742464:0@lo:400:kworker.0 00000100:00080000:0.0:1789438378.172526:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789438378.172532:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876361769738368:0@lo:8:kworker.0 00000100:00100000:0.0:1789438378.172552:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876361769742208:0@lo:8:kworker.0 00000100:00100000:0.0:1789438378.172609:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438378.172643:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876361769742336:0@lo:8:kworker.0 00000100:00100000:0.0:1789438378.172664:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438378.173743:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769742208 00000100:00100000:2.0:1789438378.173754:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769742208 00000100:00100000:2.0:1789438378.173794:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769742336 00000100:00100000:2.0:1789438378.173797:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769742336 00000100:00100000:2.0:1789438378.173813:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789438378.173820:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3308:x1876361769742208:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789438378.173863:0:15087:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 430 last 0 00000020:00000080:2.0:1789438378.173897:0:15087:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7a8dd0fcbb925e76 00002000:00100000:2.0:1789438378.173912:0:15087:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9990c187c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789438378.173916:0:15087:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789438378.173919:0:15087:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789438378.174233:0:15087:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789438378.174260:0:15087:0:(import.c:65:import_set_state_nolock()) ffff9990c187f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789438378.174338:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1876361769742208:12345-0@lo:8:kworker.0 Request processed in 517us (1728us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438378.174854:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789438378.174882:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789438378.174888:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3308:x1876361769742336:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789438378.174903:0:15087:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789438378.174938:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3308:x1876361769742336:12345-0@lo:8:kworker.0 Request processed in 49us (2273us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789438378.174943:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789438378.175879:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991faab6d80 x1876361769742208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789438398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789438378.175891:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789438378.175899:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789438378.175907:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789438378.175912:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789438378.175914:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9991ffafb800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789438378.175947:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789438378.175953:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876361769742208:0@lo:8:kworker.0 00000100:00080000:0.0:1789438378.175966:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9991de19a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789438378.175971:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789438378.175974:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876361769742336:0@lo:8:kworker.0 00000004:00080000:3.0:1789438378.176062:0:14423:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789438378.176339:0:14423:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 430441630903ns, next at 0ns, rc = 0 00000004:00080000:2.0:1789438378.180654:0:14424:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:2.0:1789438378.180682:0:14424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14424:1876361769742848:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789438378.180762:0:14424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438378.180788:0:14424:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f47dea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789438378.180812:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769742720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789438378.180852:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438378.180893:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769742848 00000100:00100000:2.0:1789438378.180899:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769742848 00000100:00100000:2.0:1789438378.180950:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789438378.180959:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14424:x1876361769742848:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789438378.181895:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769742720 00000100:00100000:0.0:1789438378.181903:0:15089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769742720 00000100:00100000:0.0:1789438378.181936:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789438378.181944:0:15089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1876361769742720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789438378.181969:0:15089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438378.182024:0:15089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1876361769742720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438378.182031:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789438378.182066:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789438378.184027:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991f3d2f800 x1876361769742720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789438378.184052:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769742720:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1789438378.189805:0:15087:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1789438378.189817:0:15087:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1789438378.189822:0:15087:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:1.0:1789438378.210198:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438378.210209:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000338f1dc0/0x7a8dd0fcbb925e7d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.210228:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1789438378.210232:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438378.210238:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000338f1dc0/0x7a8dd0fcbb925e7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.210254:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000338f1dc0/0x7a8dd0fcbb925e7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.210264:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000338f1dc0/0x7a8dd0fcbb925e7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.210273:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000338f1dc0/0x7a8dd0fcbb925e7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.210298:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789438378.211805:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438378.211815:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071d7bbb2/0x7a8dd0fcbb925e84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.211830:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1789438378.211834:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438378.211840:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071d7bbb2/0x7a8dd0fcbb925e84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.211852:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071d7bbb2/0x7a8dd0fcbb925e84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.211862:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071d7bbb2/0x7a8dd0fcbb925e84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.211871:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071d7bbb2/0x7a8dd0fcbb925e84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.211889:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789438378.212213:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789438378.212221:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000338f1dc0/0x7a8dd0fcbb925e7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.212229:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9daa00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:2.0:1789438378.212239:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000338f1dc0/0x7a8dd0fcbb925e7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.212249:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000338f1dc0/0x7a8dd0fcbb925e7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789438378.212260:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438378.212265:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000714668bc/0x7a8dd0fcbb925e8b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.212266:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000338f1dc0/0x7a8dd0fcbb925e7d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.212274:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=430s v=(0 0) 00010000:00010000:2.0:1789438378.212275:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000338f1dc0/0x7a8dd0fcbb925e7d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.212281:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438378.212285:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000714668bc/0x7a8dd0fcbb925e8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.212290:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789438378.212294:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071d7bbb2/0x7a8dd0fcbb925e84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.212294:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000714668bc/0x7a8dd0fcbb925e8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.212301:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9db400 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:1.0:1789438378.212303:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000714668bc/0x7a8dd0fcbb925e8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.212304:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071d7bbb2/0x7a8dd0fcbb925e84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.212311:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000714668bc/0x7a8dd0fcbb925e8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.212312:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071d7bbb2/0x7a8dd0fcbb925e84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.212319:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789438378.212321:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071d7bbb2/0x7a8dd0fcbb925e84 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.212327:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071d7bbb2/0x7a8dd0fcbb925e84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.212344:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789438378.212359:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000714668bc/0x7a8dd0fcbb925e8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.212366:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dbc00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:2.0:1789438378.212369:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000714668bc/0x7a8dd0fcbb925e8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.212376:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000714668bc/0x7a8dd0fcbb925e8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.212386:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000714668bc/0x7a8dd0fcbb925e8b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.212392:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000714668bc/0x7a8dd0fcbb925e8b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.212403:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438378.212405:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438378.212406:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438378.212682:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789438378.215048:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438378.215060:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c8276b4/0x7a8dd0fcbb925e92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.215076:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1789438378.215081:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438378.215087:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c8276b4/0x7a8dd0fcbb925e92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.215100:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c8276b4/0x7a8dd0fcbb925e92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.215110:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c8276b4/0x7a8dd0fcbb925e92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.215125:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c8276b4/0x7a8dd0fcbb925e92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.215146:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789438378.215156:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789438378.215162:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c8276b4/0x7a8dd0fcbb925e92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.215169:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9da400 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:1.0:1789438378.215174:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c8276b4/0x7a8dd0fcbb925e92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.215183:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c8276b4/0x7a8dd0fcbb925e92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.215198:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c8276b4/0x7a8dd0fcbb925e92 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.215205:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c8276b4/0x7a8dd0fcbb925e92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.215222:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438378.215224:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438378.215225:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789438378.219782:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438378.219804:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeb0d7fe/0x7a8dd0fcbb925e99 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.219822:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1789438378.219827:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438378.219834:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aeb0d7fe/0x7a8dd0fcbb925e99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.219848:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aeb0d7fe/0x7a8dd0fcbb925e99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.219859:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeb0d7fe/0x7a8dd0fcbb925e99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.219867:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aeb0d7fe/0x7a8dd0fcbb925e99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.219891:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789438378.220340:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438378.220346:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1138995/0x7a8dd0fcbb925ea0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.220485:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789438378.220492:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aeb0d7fe/0x7a8dd0fcbb925e99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.220507:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9db000 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:0.0:1789438378.220512:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeb0d7fe/0x7a8dd0fcbb925e99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.220522:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeb0d7fe/0x7a8dd0fcbb925e99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.220540:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aeb0d7fe/0x7a8dd0fcbb925e99 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.220548:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aeb0d7fe/0x7a8dd0fcbb925e99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.220566:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438378.220568:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438378.220569:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438378.220612:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1789438378.220616:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438378.220621:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1138995/0x7a8dd0fcbb925ea0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.220632:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1138995/0x7a8dd0fcbb925ea0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.220649:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1138995/0x7a8dd0fcbb925ea0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.220656:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1138995/0x7a8dd0fcbb925ea0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.220728:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789438378.221136:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438378.221142:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b97342d4/0x7a8dd0fcbb925ea7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.221151:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1789438378.221154:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438378.221158:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b97342d4/0x7a8dd0fcbb925ea7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.221168:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b97342d4/0x7a8dd0fcbb925ea7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.221176:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b97342d4/0x7a8dd0fcbb925ea7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.221183:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b97342d4/0x7a8dd0fcbb925ea7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.221968:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789438378.221977:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1138995/0x7a8dd0fcbb925ea0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.221986:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9db800 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:0.0:1789438378.221990:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1138995/0x7a8dd0fcbb925ea0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.222000:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1138995/0x7a8dd0fcbb925ea0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.222023:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1138995/0x7a8dd0fcbb925ea0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.222031:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1138995/0x7a8dd0fcbb925ea0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.222049:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789438378.222052:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b97342d4/0x7a8dd0fcbb925ea7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.222057:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dac00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:0.0:1789438378.222060:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b97342d4/0x7a8dd0fcbb925ea7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.222067:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b97342d4/0x7a8dd0fcbb925ea7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.222075:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b97342d4/0x7a8dd0fcbb925ea7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.222081:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438378.222082:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438378.222084:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438378.222173:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789438378.222179:0:15087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b97342d4/0x7a8dd0fcbb925ea7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789438378.222823:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438378.222831:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925eae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.222842:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1789438378.222845:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438378.222850:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925eae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.222860:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925eae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.222868:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925eae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.222875:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925eae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.222929:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789438378.222935:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925eae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.222953:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dbe00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:0.0:1789438378.222957:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925eae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.222965:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925eae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.222976:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925eae lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.222984:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438378.222986:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438378.222988:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438378.223056:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789438378.223061:0:15087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbf52bd0/0x7a8dd0fcbb925eae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789438378.223567:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438378.223573:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002af35e79/0x7a8dd0fcbb925eb5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.223582:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1789438378.223597:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438378.223602:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002af35e79/0x7a8dd0fcbb925eb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.223611:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002af35e79/0x7a8dd0fcbb925eb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.223619:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002af35e79/0x7a8dd0fcbb925eb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.223625:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002af35e79/0x7a8dd0fcbb925eb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.226306:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789438378.226321:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002af35e79/0x7a8dd0fcbb925eb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.226334:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9da000 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:0.0:1789438378.226339:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002af35e79/0x7a8dd0fcbb925eb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.226349:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002af35e79/0x7a8dd0fcbb925eb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.226633:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002af35e79/0x7a8dd0fcbb925eb5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.226653:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438378.226655:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438378.226657:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438378.227453:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789438378.227462:0:15087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002af35e79/0x7a8dd0fcbb925eb5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789438378.228169:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438378.228176:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e683ca0c/0x7a8dd0fcbb925ebc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.228199:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1789438378.228204:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438378.228210:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e683ca0c/0x7a8dd0fcbb925ebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.228221:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e683ca0c/0x7a8dd0fcbb925ebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.228230:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e683ca0c/0x7a8dd0fcbb925ebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.228239:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e683ca0c/0x7a8dd0fcbb925ebc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.228264:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789438378.228338:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789438378.228345:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e683ca0c/0x7a8dd0fcbb925ebc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.228365:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9da600 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:2.0:1789438378.228375:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e683ca0c/0x7a8dd0fcbb925ebc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.228384:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e683ca0c/0x7a8dd0fcbb925ebc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.228398:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e683ca0c/0x7a8dd0fcbb925ebc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.228405:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e683ca0c/0x7a8dd0fcbb925ebc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.228420:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438378.228422:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438378.228424:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438378.228461:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789438378.229250:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438378.229256:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb925ec3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.229266:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1789438378.229270:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438378.229275:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb925ec3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.229285:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb925ec3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.229305:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb925ec3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.229313:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb925ec3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.229337:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789438378.229434:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789438378.229439:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb925ec3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.229447:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dba00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:2.0:1789438378.229451:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb925ec3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.229459:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb925ec3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.229471:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb925ec3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.229483:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1d096e6/0x7a8dd0fcbb925ec3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.229499:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438378.229501:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438378.229503:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789438378.232704:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438378.232740:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1fb04b1/0x7a8dd0fcbb925eca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.232757:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1789438378.232761:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438378.232767:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1fb04b1/0x7a8dd0fcbb925eca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.232781:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1fb04b1/0x7a8dd0fcbb925eca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.232791:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1fb04b1/0x7a8dd0fcbb925eca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.232799:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1fb04b1/0x7a8dd0fcbb925eca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.233519:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789438378.233526:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1fb04b1/0x7a8dd0fcbb925eca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.233537:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0715600 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:2.0:1789438378.233541:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1fb04b1/0x7a8dd0fcbb925eca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.233551:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1fb04b1/0x7a8dd0fcbb925eca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.233569:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1fb04b1/0x7a8dd0fcbb925eca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.233578:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438378.233579:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438378.233581:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438378.234435:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789438378.234444:0:15087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1fb04b1/0x7a8dd0fcbb925eca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789438378.235045:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438378.235052:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c0db4fd/0x7a8dd0fcbb925ed1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.237863:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1789438378.237868:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438378.237876:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c0db4fd/0x7a8dd0fcbb925ed1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.237894:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c0db4fd/0x7a8dd0fcbb925ed1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.237905:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c0db4fd/0x7a8dd0fcbb925ed1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.237913:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c0db4fd/0x7a8dd0fcbb925ed1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.237933:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789438378.237947:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789438378.237953:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c0db4fd/0x7a8dd0fcbb925ed1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.237969:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0715e00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:1.0:1789438378.237974:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c0db4fd/0x7a8dd0fcbb925ed1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.237983:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c0db4fd/0x7a8dd0fcbb925ed1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.237998:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c0db4fd/0x7a8dd0fcbb925ed1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.238005:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c0db4fd/0x7a8dd0fcbb925ed1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.238024:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438378.238026:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438378.238028:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789438378.238746:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438378.238754:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a8ff063/0x7a8dd0fcbb925ed8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.238764:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1789438378.238768:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438378.238773:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a8ff063/0x7a8dd0fcbb925ed8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.238782:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a8ff063/0x7a8dd0fcbb925ed8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.238799:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a8ff063/0x7a8dd0fcbb925ed8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.238806:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a8ff063/0x7a8dd0fcbb925ed8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.238822:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789438378.239200:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438378.239206:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c130b1df/0x7a8dd0fcbb925edf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.239214:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1789438378.239217:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438378.239221:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c130b1df/0x7a8dd0fcbb925edf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.239231:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c130b1df/0x7a8dd0fcbb925edf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.239239:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c130b1df/0x7a8dd0fcbb925edf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.239246:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c130b1df/0x7a8dd0fcbb925edf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.239272:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789438378.239284:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789438378.239288:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a8ff063/0x7a8dd0fcbb925ed8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.239296:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0715200 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:1.0:1789438378.239299:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a8ff063/0x7a8dd0fcbb925ed8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.239308:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a8ff063/0x7a8dd0fcbb925ed8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.239322:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a8ff063/0x7a8dd0fcbb925ed8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.239329:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a8ff063/0x7a8dd0fcbb925ed8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.239346:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789438378.239349:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c130b1df/0x7a8dd0fcbb925edf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.240891:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0714200 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:1.0:1789438378.240896:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c130b1df/0x7a8dd0fcbb925edf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.240919:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c130b1df/0x7a8dd0fcbb925edf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.240937:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c130b1df/0x7a8dd0fcbb925edf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.240944:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c130b1df/0x7a8dd0fcbb925edf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.240963:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438378.240965:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438378.240966:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789438378.241671:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438378.241679:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000522f766d/0x7a8dd0fcbb925ee6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.241691:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1789438378.241695:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438378.241700:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000522f766d/0x7a8dd0fcbb925ee6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.241744:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000522f766d/0x7a8dd0fcbb925ee6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.241753:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000522f766d/0x7a8dd0fcbb925ee6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.241769:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000522f766d/0x7a8dd0fcbb925ee6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.241789:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789438378.242177:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438378.242183:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a4cf453/0x7a8dd0fcbb925eed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.242192:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1789438378.242195:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438378.242199:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a4cf453/0x7a8dd0fcbb925eed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.242207:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a4cf453/0x7a8dd0fcbb925eed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.242215:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a4cf453/0x7a8dd0fcbb925eed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.242223:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a4cf453/0x7a8dd0fcbb925eed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.242232:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789438378.242490:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789438378.242496:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000522f766d/0x7a8dd0fcbb925ee6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.242505:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0715000 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:0.0:1789438378.242510:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000522f766d/0x7a8dd0fcbb925ee6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.242603:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000522f766d/0x7a8dd0fcbb925ee6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.242618:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000522f766d/0x7a8dd0fcbb925ee6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.242625:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000522f766d/0x7a8dd0fcbb925ee6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.242641:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789438378.242644:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a4cf453/0x7a8dd0fcbb925eed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.242650:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0715c00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:0.0:1789438378.242660:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a4cf453/0x7a8dd0fcbb925eed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.242667:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a4cf453/0x7a8dd0fcbb925eed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.242677:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a4cf453/0x7a8dd0fcbb925eed lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.242684:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a4cf453/0x7a8dd0fcbb925eed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.242696:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438378.242698:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438378.242699:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789438378.244255:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438378.244266:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f93a262e/0x7a8dd0fcbb925ef4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.244285:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1789438378.244289:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438378.244295:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f93a262e/0x7a8dd0fcbb925ef4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.244306:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f93a262e/0x7a8dd0fcbb925ef4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.244315:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f93a262e/0x7a8dd0fcbb925ef4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.244322:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f93a262e/0x7a8dd0fcbb925ef4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.244345:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789438378.244952:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438378.244959:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009778bcfa/0x7a8dd0fcbb925efb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.244968:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1789438378.244971:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438378.244975:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009778bcfa/0x7a8dd0fcbb925efb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.244985:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009778bcfa/0x7a8dd0fcbb925efb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.245005:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009778bcfa/0x7a8dd0fcbb925efb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.245012:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009778bcfa/0x7a8dd0fcbb925efb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.245020:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789438378.245415:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438378.245421:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026533e85/0x7a8dd0fcbb925f02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.245429:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1789438378.245432:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438378.245436:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026533e85/0x7a8dd0fcbb925f02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.245445:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026533e85/0x7a8dd0fcbb925f02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.245453:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026533e85/0x7a8dd0fcbb925f02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.245460:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026533e85/0x7a8dd0fcbb925f02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.245478:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789438378.245702:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789438378.245724:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f93a262e/0x7a8dd0fcbb925ef4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.245733:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0715800 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:0.0:1789438378.245737:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f93a262e/0x7a8dd0fcbb925ef4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.245746:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f93a262e/0x7a8dd0fcbb925ef4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.245762:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f93a262e/0x7a8dd0fcbb925ef4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.245776:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f93a262e/0x7a8dd0fcbb925ef4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.245796:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789438378.245800:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009778bcfa/0x7a8dd0fcbb925efb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.245806:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0714400 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:0.0:1789438378.245809:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009778bcfa/0x7a8dd0fcbb925efb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.245817:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009778bcfa/0x7a8dd0fcbb925efb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.245827:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009778bcfa/0x7a8dd0fcbb925efb lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.245834:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009778bcfa/0x7a8dd0fcbb925efb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.245846:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789438378.245850:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026533e85/0x7a8dd0fcbb925f02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.245856:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0714800 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:0.0:1789438378.245866:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026533e85/0x7a8dd0fcbb925f02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.245874:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026533e85/0x7a8dd0fcbb925f02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.245885:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026533e85/0x7a8dd0fcbb925f02 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.245892:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026533e85/0x7a8dd0fcbb925f02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.245905:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438378.245907:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438378.245909:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789438378.246453:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438378.246459:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8024e75/0x7a8dd0fcbb925f09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.246469:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1789438378.246473:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438378.246478:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8024e75/0x7a8dd0fcbb925f09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.246488:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8024e75/0x7a8dd0fcbb925f09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.246496:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8024e75/0x7a8dd0fcbb925f09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.246503:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8024e75/0x7a8dd0fcbb925f09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.246535:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789438378.246960:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438378.246966:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c521d58/0x7a8dd0fcbb925f10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.246975:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1789438378.246982:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438378.246987:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c521d58/0x7a8dd0fcbb925f10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.246996:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c521d58/0x7a8dd0fcbb925f10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.247005:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c521d58/0x7a8dd0fcbb925f10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.247012:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c521d58/0x7a8dd0fcbb925f10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.247021:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789438378.247555:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789438378.247562:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8024e75/0x7a8dd0fcbb925f09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.247571:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0714a00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:0.0:1789438378.247574:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8024e75/0x7a8dd0fcbb925f09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.247582:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8024e75/0x7a8dd0fcbb925f09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.247609:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8024e75/0x7a8dd0fcbb925f09 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.247622:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8024e75/0x7a8dd0fcbb925f09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.247640:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789438378.247644:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c521d58/0x7a8dd0fcbb925f10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.247649:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0714e00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:0.0:1789438378.247652:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c521d58/0x7a8dd0fcbb925f10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.247659:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c521d58/0x7a8dd0fcbb925f10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.247669:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c521d58/0x7a8dd0fcbb925f10 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.247675:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c521d58/0x7a8dd0fcbb925f10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.247687:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438378.247688:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438378.247690:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438378.247825:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789438378.252947:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438378.252961:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9056860/0x7a8dd0fcbb925f17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.252979:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1789438378.252983:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438378.252989:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9056860/0x7a8dd0fcbb925f17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.253002:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9056860/0x7a8dd0fcbb925f17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.253011:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9056860/0x7a8dd0fcbb925f17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.253027:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9056860/0x7a8dd0fcbb925f17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.253049:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789438378.253062:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789438378.253067:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9056860/0x7a8dd0fcbb925f17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.253074:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0715400 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:1.0:1789438378.253079:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9056860/0x7a8dd0fcbb925f17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.253087:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9056860/0x7a8dd0fcbb925f17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.253104:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9056860/0x7a8dd0fcbb925f17 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.253111:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9056860/0x7a8dd0fcbb925f17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.253137:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438378.253139:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438378.253141:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789438378.254212:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438378.254228:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000223fad38/0x7a8dd0fcbb925f1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.254239:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1789438378.254242:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438378.254247:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000223fad38/0x7a8dd0fcbb925f1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.254258:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000223fad38/0x7a8dd0fcbb925f1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.254266:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000223fad38/0x7a8dd0fcbb925f1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.254274:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000223fad38/0x7a8dd0fcbb925f1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.254296:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789438378.254933:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438378.254939:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5242d89/0x7a8dd0fcbb925f25 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.254948:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1789438378.254952:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438378.254956:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5242d89/0x7a8dd0fcbb925f25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.254966:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5242d89/0x7a8dd0fcbb925f25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.254980:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5242d89/0x7a8dd0fcbb925f25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.254988:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5242d89/0x7a8dd0fcbb925f25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438378.255006:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789438378.256029:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789438378.256038:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000223fad38/0x7a8dd0fcbb925f1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438378.256049:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0714c00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:3.0:1789438378.256053:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000223fad38/0x7a8dd0fcbb925f1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438378.256062:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000223fad38/0x7a8dd0fcbb925f1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438378.256083:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000223fad38/0x7a8dd0fcbb925f1e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438378.256097:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000223fad38/0x7a8dd0fcbb925f1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438378.256120:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789438378.256124:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5242d89/0x7a8dd0fcbb925f25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438378.256131:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0714600 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:3.0:1789438378.256134:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5242d89/0x7a8dd0fcbb925f25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438378.256141:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5242d89/0x7a8dd0fcbb925f25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438378.256152:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5242d89/0x7a8dd0fcbb925f25 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438378.256159:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5242d89/0x7a8dd0fcbb925f25 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438378.256171:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438378.256172:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438378.256174:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438378.257951:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789438378.258695:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789438378.258704:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925f2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438378.258741:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1789438378.258745:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438378.258751:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925f2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438378.258764:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925f2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438378.258774:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925f2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438378.258782:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925f2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438378.258798:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789438378.258809:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789438378.258814:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925f2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438378.258821:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54200 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:3.0:1789438378.258825:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925f2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438378.258833:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925f2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438378.258859:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925f2c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438378.258866:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925f2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438378.258880:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438378.258882:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438378.258884:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789438378.259309:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789438378.259315:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6357179/0x7a8dd0fcbb925f33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438378.259324:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1789438378.259327:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438378.259331:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6357179/0x7a8dd0fcbb925f33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438378.259340:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6357179/0x7a8dd0fcbb925f33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438378.259349:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6357179/0x7a8dd0fcbb925f33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438378.261777:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6357179/0x7a8dd0fcbb925f33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.262650:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789438378.262665:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789438378.262677:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6357179/0x7a8dd0fcbb925f33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.262687:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54800 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:0.0:1789438378.262691:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6357179/0x7a8dd0fcbb925f33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.262701:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6357179/0x7a8dd0fcbb925f33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.262743:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6357179/0x7a8dd0fcbb925f33 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.262751:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6357179/0x7a8dd0fcbb925f33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.262769:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438378.262771:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438378.262772:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789438378.263299:0:15087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789438378.263306:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000268961ee/0x7a8dd0fcbb925f3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.263318:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=430s v=(0 0) 00010000:00010000:0.0:1789438378.263322:0:15087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789438378.263328:0:15087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000268961ee/0x7a8dd0fcbb925f3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.263482:0:15087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000268961ee/0x7a8dd0fcbb925f3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.263494:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000268961ee/0x7a8dd0fcbb925f3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.263503:0:15087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000268961ee/0x7a8dd0fcbb925f3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438378.263532:0:15087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1789438378.263748:0:15087:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1789438378.263828:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14424:x1876361769742848:12345-0@lo:5:osp-pre-0-0.0 Request processed in 82867us (83063us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438378.263841:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789438378.264009:0:14424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14424:1876361769742848:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789438378.264023:0:14424:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1789438378.264072:0:14424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14424:1876361769742976:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789438378.264105:0:14424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438378.264149:0:14424:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f47dea80 going to sleep for 11 seconds 00000100:00100000:0.0:1789438378.264641:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769742976 00000100:00100000:0.0:1789438378.264648:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769742976 00000100:00100000:0.0:1789438378.264691:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789438378.264701:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14424:x1876361769742976:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1789438378.264762:0:15088:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:2.0:1789438378.267765:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789438378.267775:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000268961ee/0x7a8dd0fcbb925f3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.267788:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d62400 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:2.0:1789438378.267793:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000268961ee/0x7a8dd0fcbb925f3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.267804:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000268961ee/0x7a8dd0fcbb925f3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.267824:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000268961ee/0x7a8dd0fcbb925f3a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.267832:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000268961ee/0x7a8dd0fcbb925f3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438378.267853:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438378.267855:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438378.267857:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438378.273671:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14424:x1876361769742976:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8966us (9559us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789438378.273685:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789438378.273766:0:14424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14424:1876361769742976:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789438378.273780:0:14424:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000004:00080000:2.0:1789438378.276638:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000001:00080000:1.0:1789438378.376918:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1789438378.376963:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1789438378.934925:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438379.965433:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438380.989098:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438382.008119:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789438382.199845:0:15804:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789438382.199857:0:15804:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1789438382.200309:0:15804:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9990c187d000 00000020:01000004:2.0:1789438382.200323:0:15804:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789438382.200334:0:15804:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789438382.200346:0:15804:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9991ff9999c0) 00000020:00000080:2.0:1789438382.200359:0:15804:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789438382.241235:0:15804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789438382.241473:0:15804:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1789438382.244359:0:15804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789438382.244599:0:15804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1789438382.244949:0:15804:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1789438382.246229:0:15804:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 155: rc = 0 00100000:10000000:1.0:1789438382.246373:0:15804:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 155: rc = 0 00100000:10000000:1.0:1789438382.246522:0:15804:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 155: rc = 0 00100000:10000000:1.0:1789438382.247513:0:15804:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 539: rc = 0 00100000:10000000:1.0:1789438382.249536:0:15804:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 539: rc = 0 00100000:10000000:1.0:1789438382.250180:0:15804:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 539: rc = 0 00100000:10000000:1.0:1789438382.250423:0:15804:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 539: rc = 0 00100000:10000000:1.0:1789438382.251422:0:15804:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 539: rc = 0 00100000:10000000:1.0:1789438382.252367:0:15804:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 539: rc = 0 00000020:00000080:1.0:1789438382.255821:0:15804:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789438382.256164:0:15804:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789438382.256175:0:15804:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7a8dd0fcbb925f48 00000020:01000004:1.0:1789438382.256184:0:15804:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1789438382.256204:0:15804:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.109@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789438382.256207:0:15804:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789438382.256213:0:15804:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789438382.256234:0:15804:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1789438382.256237:0:15804:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.109@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789438382.275678:0:15804:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.109@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789438382.275828:0:15804:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.109@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789438382.275833:0:15804:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789438382.275835:0:15804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789438382.275836:0:15804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789438382.275837:0:15804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789438382.275838:0:15804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789438382.275840:0:15804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789438382.275956:0:15804:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789438382.275959:0:15804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789438382.275960:0:15804:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789438382.275964:0:15804:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789438382.275967:0:15804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789438382.275968:0:15804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789438382.275969:0:15804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789438382.275970:0:15804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789438382.275971:0:15804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789438382.275972:0:15804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789438382.275973:0:15804:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789438382.275974:0:15804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789438382.275975:0:15804:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789438382.276001:0:15804:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789438382.276022:0:15804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769743104:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789438382.276090:0:15804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438382.276193:0:15804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c8621840 going to sleep for 11 seconds 00000100:00100000:1.0:1789438382.278789:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769743104 00000100:00100000:1.0:1789438382.278801:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769743104 00000100:00100000:1.0:1789438382.279295:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789438382.279307:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+16:15804:x1876361769743104:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789438382.279338:0:14396:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789438382.279342:0:14396:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1789438382.279345:0:14396:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789438382.312837:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+16:15804:x1876361769743104:12345-0@lo:253:mount.lustre.0 Request processed in 33525us (36738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438382.312850:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789438382.313050:0:15804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769743104:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789438382.313066:0:15804:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789438382.313068:0:15804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789438382.313070:0:15804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789438382.313085:0:15804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789438382.313086:0:15804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789438382.313087:0:15804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789438382.313089:0:15804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789438382.313090:0:15804:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789438382.313092:0:15804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789438382.313093:0:15804:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789438382.313113:0:15804:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9990c187d000 from lustre-OST0001 10000000:01000000:2.0:1789438382.313139:0:15804:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789438382.313142:0:15804:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789438382.313150:0:15804:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9991ffba19c0 local copy 00010000:00010000:2.0:1789438382.313160:0:15804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991f3d62800/0x7a8dd0fcbb925cee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925cf5 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438382.313385:0:15804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769743232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789438382.313420:0:15804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438382.313467:0:15804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9990c1385780 going to sleep for 11 seconds 00000100:00100000:0.0:1789438382.315855:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769743232 00000100:00100000:0.0:1789438382.315880:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769743232 00000100:00100000:0.0:1789438382.315942:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789438382.315951:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+16:15804:x1876361769743232:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789438382.316194:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+16:15804:x1876361769743232:12345-0@lo:501:mount.lustre.0 Request processed in 243us (2773us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789438382.316201:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789438382.316683:0:15804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769743232:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789438382.316725:0:15804:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789438382.316906:0:15804:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789438382.316914:0:15804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991f3d62800/0x7a8dd0fcbb925cee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925cf5 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438382.316925:0:15804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991f3d62800/0x7a8dd0fcbb925cee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925cf5 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789438382.316955:0:15804:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9990c187d000 10000000:01000000:1.0:1789438382.316960:0:15804:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789438382.316966:0:15804:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789438382.316969:0:15804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789438382.316973:0:15804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789438382.316981:0:15804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789438382.317010:0:15804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991e0714000/0x7a8dd0fcbb925f4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438382.317018:0:15804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991e0714000/0x7a8dd0fcbb925f4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438382.317027:0:15804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991e0714000/0x7a8dd0fcbb925f4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438382.317046:0:15804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769743360:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789438382.317083:0:15804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438382.317122:0:15804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e1f4e780 going to sleep for 11 seconds 00000100:00100000:2.0:1789438382.317670:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769743360 00000100:00100000:2.0:1789438382.317677:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769743360 00000100:00100000:2.0:1789438382.317736:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789438382.317745:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+16:15804:x1876361769743360:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789438382.317755:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438382.317767:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c69e0e00/0x7a8dd0fcbb925f56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb925f4f expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438382.317788:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c69e0e00/0x7a8dd0fcbb925f56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925f4f expref: 17 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438382.317798:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c69e0e00/0x7a8dd0fcbb925f56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925f4f expref: 17 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438382.317807:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c69e0e00, rc 0) 00000100:00100000:2.0:1789438382.317850:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+17:15804:x1876361769743360:12345-0@lo:101:mount.lustre.0 Request processed in 107us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438382.317857:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789438382.318797:0:15804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769743360:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789438382.318814:0:15804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991e0714000/0x7a8dd0fcbb925f4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925f56 expref: -99 pid: 15804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438382.318824:0:15804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991e0714000/0x7a8dd0fcbb925f4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb925f56 expref: -99 pid: 15804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789438382.319428:0:15804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789438382.320225:0:15804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789438382.320462:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789438382.320506:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789438382.320537:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789438382.320599:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789438382.320635:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789438382.320669:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789438382.320771:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789438382.320780:0:15804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789438382.320856:0:15804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769743488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789438382.320909:0:15804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438382.320939:0:15804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e1f4e240 going to sleep for 11 seconds 00000100:00100000:2.0:1789438382.322218:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769743488 00000100:00100000:2.0:1789438382.322228:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769743488 00000100:00100000:2.0:1789438382.322280:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789438382.322289:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+17:15804:x1876361769743488:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789438382.322694:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+17:15804:x1876361769743488:12345-0@lo:501:mount.lustre.0 Request processed in 406us (1784us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438382.322702:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789438382.322901:0:15804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769743488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789438382.322957:0:15804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff93a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769743616:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789438382.323000:0:15804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438382.323034:0:15804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fabaa000 going to sleep for 11 seconds 00000100:00100000:2.0:1789438382.323507:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769743616 00000100:00100000:2.0:1789438382.323513:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769743616 00000100:00100000:2.0:1789438382.323548:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789438382.323556:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+17:15804:x1876361769743616:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789438382.324223:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+17:15804:x1876361769743616:12345-0@lo:503:mount.lustre.0 Request processed in 665us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438382.324232:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789438382.326407:0:15804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff93a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769743616:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789438382.329701:0:15804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789438382.346548:0:15804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff938380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769743744:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789438382.346642:0:15804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438382.346685:0:15804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fabaa480 going to sleep for 11 seconds 00000100:00100000:2.0:1789438382.348775:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769743744 00000100:00100000:2.0:1789438382.348787:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769743744 00000100:00100000:2.0:1789438382.348847:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789438382.348858:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+17:15804:x1876361769743744:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789438382.349146:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+17:15804:x1876361769743744:12345-0@lo:502:mount.lustre.0 Request processed in 290us (2504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438382.349153:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789438382.349312:0:15804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff938380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769743744:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789438382.349611:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1789438382.349665:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1789438382.349700:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1789438382.349785:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1789438382.349825:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1789438382.349872:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1789438382.349921:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1789438382.349958:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1789438382.350006:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1789438382.350046:0:15804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff938380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769743872:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789438382.350100:0:15804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438382.350137:0:15804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fabaa480 going to sleep for 11 seconds 00000100:00100000:3.0:1789438382.350355:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769743872 00000100:00100000:3.0:1789438382.350362:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769743872 00000100:00100000:3.0:1789438382.350394:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789438382.350403:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+17:15804:x1876361769743872:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789438382.350589:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+17:15804:x1876361769743872:12345-0@lo:502:mount.lustre.0 Request processed in 187us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438382.350597:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789438382.350684:0:15804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff938380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769743872:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789438382.350799:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1789438382.350811:0:15804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1789438382.353434:0:15805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789438382.353446:0:15805:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1789438382.353454:0:15805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789438382.353456:0:15805:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789438382.353462:0:15805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789438382.353479:0:15805:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9991fa9b3380) 00000020:00000080:0.0:1789438382.353502:0:15805:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789438382.353508:0:15805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789438382.353614:0:15805:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9990c187d000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789438382.353622:0:15805:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789438382.353630:0:15805:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7a8dd0fcbb925f64 00010000:00010000:0.0:1789438382.359238:0:15805:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1789438382.360258:0:15805:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1789438382.371886:0:15805:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1789438382.374639:0:15805:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789438382.374651:0:15805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789438382.374657:0:15805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789438382.374664:0:15805:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789438382.374670:0:15805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789438382.374674:0:15805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789438382.374675:0:15805:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789438382.374678:0:15805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789438382.374680:0:15805:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789438382.374682:0:15805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789438382.374684:0:15805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789438382.374685:0:15805:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789438382.374688:0:15805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789438382.374690:0:15805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789438382.374691:0:15805:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789438382.374695:0:15805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789438382.374772:0:15805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789438382.374776:0:15805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789438382.374778:0:15805:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789438382.374782:0:15805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1789438382.379759:0:15804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1789438382.379799:0:15804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789438382.379823:0:15804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991e0714000/0x7a8dd0fcbb925f4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925f56 expref: -99 pid: 15804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438382.379835:0:15804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991e0714000/0x7a8dd0fcbb925f4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925f56 expref: -99 pid: 15804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789438382.379852:0:15804:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9990c187d000 from 1 10000000:01000000:1.0:1789438382.379855:0:15804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789438382.379901:0:15804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991e0715600/0x7a8dd0fcbb925f6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438382.379909:0:15804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991e0715600/0x7a8dd0fcbb925f6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438382.379920:0:15804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991e0715600/0x7a8dd0fcbb925f6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438382.379943:0:15804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769744000:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789438382.380005:0:15804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438382.380067:0:15804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e1f4e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789438382.382217:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769744000 00000100:00100000:3.0:1789438382.382231:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769744000 00000100:00100000:3.0:1789438382.382287:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789438382.382297:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+17:15804:x1876361769744000:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789438382.382313:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438382.382327:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c2a55e00/0x7a8dd0fcbb925f72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb925f6b expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438382.382352:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c2a55e00/0x7a8dd0fcbb925f72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925f6b expref: 18 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438382.382362:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c2a55e00/0x7a8dd0fcbb925f72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925f6b expref: 18 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438382.382370:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a55e00, rc 0) 00000100:00100000:3.0:1789438382.382438:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+18:15804:x1876361769744000:12345-0@lo:101:mount.lustre.0 Request processed in 142us (2432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438382.382444:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789438382.386689:0:15804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769744000:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789438382.386785:0:15804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991e0715600/0x7a8dd0fcbb925f6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925f72 expref: -99 pid: 15804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438382.386799:0:15804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991e0715600/0x7a8dd0fcbb925f6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb925f72 expref: -99 pid: 15804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789438382.387988:0:15804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789438382.388958:0:15804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789438382.391409:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789438382.391475:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789438382.391574:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789438382.391584:0:15804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789438382.391673:0:15804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff938e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769744128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789438382.391846:0:15804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438382.391993:0:15804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c5e00e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789438382.394676:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769744128 00000100:00100000:2.0:1789438382.394689:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769744128 00000100:00100000:2.0:1789438382.394764:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789438382.394775:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4404050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+18:15804:x1876361769744128:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789438382.395405:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4404050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+18:15804:x1876361769744128:12345-0@lo:501:mount.lustre.0 Request processed in 631us (3557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438382.395413:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789438382.396455:0:15804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff938e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769744128:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789438382.396520:0:15804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769744256:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789438382.396596:0:15804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438382.396634:0:15804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e1f4ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789438382.396853:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769744256 00000100:00100000:2.0:1789438382.396860:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769744256 00000100:00100000:2.0:1789438382.396910:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789438382.396918:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+18:15804:x1876361769744256:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789438382.397229:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+18:15804:x1876361769744256:12345-0@lo:503:mount.lustre.0 Request processed in 311us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438382.397239:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789438382.397646:0:15804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769744256:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789438382.406934:0:15804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789438382.407035:0:15804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff93b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769744384:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789438382.407119:0:15804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438382.407165:0:15804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c5e00a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789438382.407273:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769744384 00000100:00100000:2.0:1789438382.407280:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769744384 00000100:00100000:2.0:1789438382.407328:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789438382.407338:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+18:15804:x1876361769744384:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789438382.407595:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+18:15804:x1876361769744384:12345-0@lo:502:mount.lustre.0 Request processed in 257us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438382.407602:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789438382.412889:0:15804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff93b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769744384:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789438382.413176:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789438382.413234:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789438382.413279:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789438382.413313:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789438382.413344:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789438382.413387:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789438382.413423:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789438382.413457:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1789438382.413497:0:15804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769744512:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789438382.417055:0:15804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438382.417142:0:15804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991ff88d180 going to sleep for 11 seconds 00000100:00100000:0.0:1789438382.421262:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769744512 00000100:00100000:0.0:1789438382.421277:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769744512 00000100:00100000:0.0:1789438382.421348:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789438382.421359:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+18:15804:x1876361769744512:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789438382.421792:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+18:15804:x1876361769744512:12345-0@lo:502:mount.lustre.0 Request processed in 434us (4742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438382.421801:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789438382.422067:0:15804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769744512:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789438382.422211:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789438382.422225:0:15804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789438382.424315:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789438382.424327:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789438382.424329:0:15809:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789438382.424336:0:15809:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9990c187d000 00000020:00000080:0.0:1789438382.424339:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789438382.424346:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789438382.424349:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789438382.424350:0:15809:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789438382.424353:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789438382.424355:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789438382.424356:0:15809:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789438382.424359:0:15809:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9990c187d000 00000020:00000080:0.0:1789438382.424373:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789438382.424477:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789438382.424482:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789438382.424483:0:15809:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789438382.424486:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789438382.424488:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789438382.424489:0:15809:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789438382.424492:0:15809:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9990c187d000 00000020:00000080:0.0:1789438382.424494:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789438382.436804:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789438382.436815:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789438382.436818:0:15809:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789438382.436823:0:15809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1789438382.437962:0:15804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789438382.437995:0:15804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789438382.438020:0:15804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991e0715600/0x7a8dd0fcbb925f6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925f72 expref: -99 pid: 15804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438382.438032:0:15804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991e0715600/0x7a8dd0fcbb925f6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925f72 expref: -99 pid: 15804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789438382.438077:0:15804:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789438382.438081:0:15804:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9990c187d000 10000000:01000000:2.0:1789438382.438083:0:15804:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9990c187d000 10000000:01000000:2.0:1789438382.438087:0:15804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789438382.438093:0:15804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9990c187d000 from 1 10000000:01000000:2.0:1789438382.438096:0:15804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789438382.438129:0:15804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c69e0c00/0x7a8dd0fcbb925f79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438382.438138:0:15804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991c69e0c00/0x7a8dd0fcbb925f79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438382.438147:0:15804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991c69e0c00/0x7a8dd0fcbb925f79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438382.438181:0:15804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769744640:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789438382.438239:0:15804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438382.438282:0:15804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c8621840 going to sleep for 11 seconds 00000100:00100000:0.0:1789438382.438411:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769744640 00000100:00100000:0.0:1789438382.438419:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769744640 00000100:00100000:0.0:1789438382.438457:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789438382.438465:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d080b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+18:15804:x1876361769744640:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789438382.438477:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438382.438503:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991f3d63200/0x7a8dd0fcbb925f80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb925f79 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438382.438704:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991f3d63200/0x7a8dd0fcbb925f80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925f79 expref: 19 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438382.438731:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991f3d63200/0x7a8dd0fcbb925f80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925f79 expref: 19 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438382.438740:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63200, rc 0) 00000100:00100000:0.0:1789438382.438780:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d080b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+19:15804:x1876361769744640:12345-0@lo:101:mount.lustre.0 Request processed in 316us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438382.438786:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789438382.439981:0:15804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769744640:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789438382.440001:0:15804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991c69e0c00/0x7a8dd0fcbb925f79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925f80 expref: -99 pid: 15804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438382.440012:0:15804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991c69e0c00/0x7a8dd0fcbb925f79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb925f80 expref: -99 pid: 15804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789438382.442115:0:15804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1789438382.449295:0:15804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789438382.453234:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789438382.453319:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789438382.453349:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789438382.453386:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789438382.453415:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789438382.453453:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789438382.453481:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789438382.453507:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789438382.453572:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789438382.453606:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789438382.453634:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789438382.453672:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789438382.453700:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789438382.453747:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789438382.453792:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789438382.453828:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789438382.453861:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789438382.461791:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789438382.461888:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789438382.461927:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789438382.461979:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789438382.462014:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789438382.462048:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789438382.462095:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789438382.462131:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1789438382.462165:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1789438382.462212:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1789438382.462246:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1789438382.462280:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1789438382.462327:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1789438382.462365:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1789438382.462399:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1789438382.462434:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1789438382.462481:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1789438382.462516:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1789438382.465423:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1789438382.465477:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1789438382.465583:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1789438382.465592:0:15804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1789438382.465699:0:15804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769744768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789438382.465771:0:15804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438382.465817:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769744768 00000100:00100000:2.0:1789438382.465824:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769744768 00000100:00100000:2.0:1789438382.465867:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789438382.465876:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d080b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+19:15804:x1876361769744768:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789438382.466065:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d080b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+19:15804:x1876361769744768:12345-0@lo:501:mount.lustre.0 Request processed in 190us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438382.466082:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789438382.466119:0:15804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c8621840 going to sleep for 11 seconds 00000100:00100000:2.0:1789438382.466137:0:15804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769744768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789438382.466167:0:15804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769744896:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789438382.466200:0:15804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438382.466219:0:15804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991fa9f1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789438382.466221:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769744896 00000100:00100000:0.0:1789438382.466226:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769744896 00000100:00100000:0.0:1789438382.466259:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789438382.466267:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d0809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+19:15804:x1876361769744896:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789438382.466515:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d0809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+19:15804:x1876361769744896:12345-0@lo:503:mount.lustre.0 Request processed in 248us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438382.466521:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789438382.467513:0:15804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769744896:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789438382.469261:0:15804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789438382.469341:0:15804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769745024:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789438382.472910:0:15804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438382.472965:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769745024 00000100:00100000:2.0:1789438382.472973:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769745024 00000100:00100000:2.0:1789438382.473015:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789438382.473036:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d0809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+19:15804:x1876361769745024:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789438382.473346:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d0809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+19:15804:x1876361769745024:12345-0@lo:502:mount.lustre.0 Request processed in 312us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438382.473355:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789438382.473408:0:15804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c8621840 going to sleep for 11 seconds 00000100:00100000:2.0:1789438382.473429:0:15804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769745024:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789438382.477760:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789438382.477855:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789438382.477906:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789438382.477966:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789438382.478004:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789438382.478074:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789438382.478109:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789438382.478141:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789438382.478188:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789438382.478220:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789438382.478252:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789438382.478299:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789438382.478334:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789438382.478366:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789438382.478415:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789438382.478478:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789438382.478512:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789438382.478561:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789438382.478609:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789438382.478666:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789438382.478738:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789438382.478774:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789438382.478807:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789438382.478853:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789438382.478883:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1789438382.478910:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1789438382.478957:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1789438382.478991:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1789438382.479019:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1789438382.479063:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1789438382.479095:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1789438382.479125:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1789438382.479155:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1789438382.479198:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1789438382.479233:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1789438382.479290:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1789438382.479321:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1789438382.479352:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1789438382.479396:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1789438382.479429:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1789438382.479481:0:15804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9990c26e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769745152:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789438382.479581:0:15804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438382.479634:0:15804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e07f9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789438382.483831:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769745152 00000100:00100000:3.0:1789438382.483844:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769745152 00000100:00100000:3.0:1789438382.483905:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789438382.483915:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d0808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+19:15804:x1876361769745152:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789438382.484208:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d0808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+19:15804:x1876361769745152:12345-0@lo:502:mount.lustre.0 Request processed in 294us (4642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438382.484217:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789438382.484329:0:15804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9990c26e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769745152:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789438382.484440:0:15804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1789438382.484456:0:15804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789438382.487369:0:15814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789438382.487406:0:15814:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9990c3020000) 00000020:00000080:1.0:1789438382.487430:0:15814:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1789438382.487513:0:15814:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9990c187d000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789438382.487516:0:15814:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9990c187d000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789438382.487518:0:15814:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9990c187d000 3 00010000:00080000:1.0:1789438382.487546:0:15814:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9991e011f800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.109@tcp at head 00010000:00010000:2.0:1789438382.496323:0:15814:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1789438382.503698:0:15814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789438382.503756:0:15814:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789438382.503768:0:15814:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x7a8dd0fcbb925f8e 00000100:00080000:2.0:1789438382.503779:0:15814:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789438382.503798:0:15814:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9991e011f800 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:2.0:1789438382.503830:0:15814:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9991f3d2d880 x1876361769745280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789438382.503865:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1876361769745280:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789438382.503925:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438382.503980:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769745280 00000100:00100000:2.0:1789438382.503987:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769745280 00000100:00100000:2.0:1789438382.504017:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789438382.504024:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1876361769745280:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789438382.504046:0:14403:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:2.0:1789438382.504073:0:14403:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x7a8dd0fcbb925f95 00000004:00100000:2.0:1789438382.504085:0:14403:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789438382.504113:0:14403:0:(import.c:65:import_set_state_nolock()) ffff9992017c2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789438382.504158:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876361769745280:12345-0@lo:38:llog_process_th.0 Request processed in 134us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438382.504165:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789438382.504199:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991f3d2d880 x1876361769745280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789438392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438382.504209:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789438382.504216:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1789438382.504223:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789438382.504227:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789438382.504229:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9991e011f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789438382.504234:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1876361769745280:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789438382.504251:0:15814:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789438382.504294:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789438382.504298:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789438382.504300:0:36:0:(import.c:65:import_set_state_nolock()) ffff9991de19a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789438382.504304:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 430 00000100:00080000:2.0:1789438382.504307:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789438382.504312:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9991de19a800 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:2.0:1789438382.504323:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9991f3d2d500 x1876361769745536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789438382.504369:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769745408:0@lo:400:kworker.0 00000100:00100000:2.0:1789438382.504396:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438382.504426:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876361769745792:0@lo:400:kworker.0 00000100:00100000:2.0:1789438382.504447:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438382.504464:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789438382.504469:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876361769745664:0@lo:400:kworker.0 00000100:00100000:2.0:1789438382.504489:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438382.504510:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769745408 00000100:00100000:2.0:1789438382.504514:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769745408 00000100:00100000:2.0:1789438382.504550:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789438382.504556:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769745408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438382.504606:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769745408:12345-0@lo:400:kworker.0 Request processed in 50us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438382.504612:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789438382.504631:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769745792 00000100:00100000:2.0:1789438382.504634:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769745792 00000100:00100000:2.0:1789438382.504657:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769745664 00000100:00100000:2.0:1789438382.504660:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769745664 00000100:00100000:2.0:1789438382.504685:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789438382.504691:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876361769745792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438382.508822:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876361769745792:12345-0@lo:400:kworker.0 Request processed in 4124us (4366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438382.508836:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789438382.508880:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789438382.508892:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876361769745664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438382.508949:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876361769745664:12345-0@lo:400:kworker.0 Request processed in 62us (4459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438382.508967:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1789438382.508991:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789438382.508996:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789438382.509032:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789438382.509049:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769745408:0@lo:400:kworker.0 00010000:00080000:2.0:1789438382.509080:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991f3d2c380 x1876361769745664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438382.509091:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876361769745664:0@lo:400:kworker.0 00010000:00080000:2.0:1789438382.509101:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9991f3d2ea00 x1876361769745792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438382.509109:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876361769745792:0@lo:400:kworker.0 00000100:00100000:2.0:1789438382.509131:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876361769745536:0@lo:8:kworker.0 00000100:00100000:2.0:1789438382.509163:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438382.509197:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769745536 00000100:00100000:2.0:1789438382.509203:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769745536 00000100:00100000:2.0:1789438382.509227:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789438382.509244:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3308:x1876361769745536:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789438382.509289:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3308:x1876361769745536:12345-0@lo:8:kworker.0 Request processed in 45us (125us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789438382.509295:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789438382.509322:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789438382.509327:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9991de19a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789438382.509330:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789438382.509333:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876361769745536:0@lo:8:kworker.0 00000040:00080000:2.0:1789438382.512325:0:15814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1789438382.512377:0:15804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789438382.512626:0:15804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789438382.513222:0:15804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c69e0c00/0x7a8dd0fcbb925f79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925f80 expref: -99 pid: 15804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438382.513236:0:15804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991c69e0c00/0x7a8dd0fcbb925f79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925f80 expref: -99 pid: 15804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789438382.513298:0:15804:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789438382.513300:0:15804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789438382.513302:0:15804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789438382.513303:0:15804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789438382.513305:0:15804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789438382.513306:0:15804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789438382.513308:0:15804:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789438382.513309:0:15804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789438382.513310:0:15804:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789438382.513314:0:15804:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1789438382.513316:0:15804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789438382.513317:0:15804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789438382.513318:0:15804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789438382.513319:0:15804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789438382.513320:0:15804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789438382.513327:0:15804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789438382.513328:0:15804:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789438382.513329:0:15804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789438382.513330:0:15804:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789438382.513365:0:15804:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789438382.513384:0:15804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769745920:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789438382.513462:0:15804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438382.513495:0:15804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c7e43b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789438382.513597:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769745920 00000100:00100000:2.0:1789438382.513604:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769745920 00000100:00100000:2.0:1789438382.513651:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789438382.513659:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d080a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+19:15804:x1876361769745920:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789438382.513686:0:14396:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789438382.513699:0:14396:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789438382.578511:0:14396:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789438382.578530:0:14396:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789438382.579407:0:14417:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789438382.579414:0:14417:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789438382.579434:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9991c69e0600/0x7a8dd0fcbb925f9c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438382.579451:0:14417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb925e6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925e68 expref: 19 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438382.579459:0:14417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9991c69e0600/0x7a8dd0fcbb925f9c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438382.579508:0:14417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb925e6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb925e68 expref: 19 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438382.579522:0:14417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb925e6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb925e68 expref: 19 pid: 14395 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438382.579654:0:14417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14417:1876361769746048:0@lo:104: 00000100:00100000:2.0:1789438382.580724:0:14417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438382.580766:0:14417:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c4cd3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789438382.591479:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769746048 00000100:00100000:0.0:1789438382.591503:0:14385:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769746048 00000100:00100000:0.0:1789438382.591678:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789438382.591689:0:14385:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b3666e65-cb7a-452a-a637-b1a251df2a46+3:14417:x1876361769746048:12345-0@lo:104: 00010000:00010000:0.0:1789438382.591725:0:14385:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9991f3d62e00/0x7a8dd0fcbb925e68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb925e6f expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438382.592057:0:14385:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789438382.592064:0:14385:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b3666e65-cb7a-452a-a637-b1a251df2a46+3:14417:x1876361769746048:12345-0@lo:104: Request processed in 379us (11359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438382.592071:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789438382.592131:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789438382.592138:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991f3d62e00/0x7a8dd0fcbb925e68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb925e6f expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438382.592147:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d62e00 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:2.0:1789438382.592151:0:14390:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991f3d62e00/0x7a8dd0fcbb925e68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb925e6f expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438382.592160:0:14390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991f3d62e00/0x7a8dd0fcbb925e68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb925e6f expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789438382.592167:0:14390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991f3d62e00/0x7a8dd0fcbb925e68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb925e6f expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789438382.592172:0:14390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789438382.592214:0:14390:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991f3d62e00/0x7a8dd0fcbb925e68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb925e6f expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438382.592221:0:14390:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789438382.592241:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991f3d62e00/0x7a8dd0fcbb925e68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb925e6f expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438382.592248:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991f3d62e00/0x7a8dd0fcbb925e68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb925e6f expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438382.592264:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438382.592266:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438382.592268:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438382.592282:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991f3d2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3666e65-cb7a-452a-a637-b1a251df2a46:3311:1876361769746176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789438382.592332:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438382.592428:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769746176 00000100:00100000:1.0:1789438382.592434:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769746176 00010000:00010000:1.0:1789438382.592454:0:14387:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb925e6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb925e68 expref: 20 pid: 14395 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438382.592484:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789438382.592501:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3120000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3666e65-cb7a-452a-a637-b1a251df2a46+20:3311:x1876361769746176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789438382.592513:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438382.592518:0:14387:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb925e6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb925e68 expref: 20 pid: 14395 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438382.592548:0:14387:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb925e6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb925e68 expref: 20 pid: 14395 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438382.592574:0:14387:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9991c69e0600/0x7a8dd0fcbb925f9c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438382.592583:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c69e0600/0x7a8dd0fcbb925f9c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789438382.592598:0:14387:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013184784s 00010000:00010000:1.0:1789438382.592603:0:14387:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9991c69e0600/0x7a8dd0fcbb925f9c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438382.592610:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9991c69e0600/0x7a8dd0fcbb925f9c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438382.592616:0:14387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9991c69e0600/0x7a8dd0fcbb925f9c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438382.592623:0:14387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9991c69e0600/0x7a8dd0fcbb925f9c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438382.592628:0:14387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c69e0600 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:1.0:1789438382.592632:0:14387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9991c69e0600/0x7a8dd0fcbb925f9c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438382.592639:0:14387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9991c69e0600/0x7a8dd0fcbb925f9c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438382.592646:0:14387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9991c69e0600/0x7a8dd0fcbb925f9c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438382.592661:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438382.592691:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3120000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3666e65-cb7a-452a-a637-b1a251df2a46+20:3311:x1876361769746176:12345-0@lo:103:ldlm_bl.0 Request processed in 201us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438382.592698:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789438382.592798:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3666e65-cb7a-452a-a637-b1a251df2a46:3311:1876361769746176:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789438382.597907:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb925e6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb925e68 expref: 19 pid: 14395 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438382.597930:0:14417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14417:1876361769746048:0@lo:104: 00010000:00010000:3.0:1789438382.597954:0:14417:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9991c69e0600/0x7a8dd0fcbb925f9c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438382.597964:0:14417:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9991c69e0600/0x7a8dd0fcbb925f9c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438382.597970:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9991c69e0600/0x7a8dd0fcbb925f9c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438382.597977:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c69e0600/0x7a8dd0fcbb925f9c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438382.605275:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d080a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+18:15804:x1876361769745920:12345-0@lo:253:mount.lustre.0 Request processed in 91608us (91803us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438382.605290:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789438382.605390:0:15804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991f3d2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b3666e65-cb7a-452a-a637-b1a251df2a46:15804:1876361769745920:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789438382.605405:0:15804:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789438382.605409:0:15804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789438382.605410:0:15804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789438382.605411:0:15804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789438382.605412:0:15804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789438382.605414:0:15804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789438382.605415:0:15804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789438382.605416:0:15804:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789438382.605418:0:15804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789438382.605419:0:15804:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789438382.605433:0:15804:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789438382.612230:0:15804:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789438382.612478:0:15804:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789438382.612693:0:15804:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789438382.612873:0:15804:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789438382.613034:0:15804:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789438382.613240:0:15804:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789438382.616157:0:15804:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789438382.738632:0:15804:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789438382.738641:0:15804:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789438382.738670:0:15804:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789438382.738760:0:15804:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.109@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789438382.738772:0:15804:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789438382.738800:0:15804:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1789438383.030946:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438383.416032:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789438383.416056:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769746304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789438383.416130:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438383.416260:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769746304 00000100:00100000:0.0:1789438383.416269:0:15089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769746304 00000100:00100000:0.0:1789438383.416324:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789438383.416333:0:15089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769746304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789438383.416363:0:15089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438383.416407:0:15089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769746304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438383.416415:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789438383.416577:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769746304:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1789438383.864103:0:14399:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789438383.864110:0:14399:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9991ff9b0800 from 8 10000000:01000000:1.0:1789438383.864115:0:14399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789438383.864166:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991e0715e00/0x7a8dd0fcbb925fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438383.864177:0:14399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991e0715e00/0x7a8dd0fcbb925fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438383.864187:0:14399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991e0715e00/0x7a8dd0fcbb925fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438383.864223:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769746432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789438383.864288:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438383.864342:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e1f4ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1789438383.864521:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769746432 00000100:00100000:2.0:1789438383.864529:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769746432 00000100:00100000:2.0:1789438383.864594:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789438383.864604:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d080ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+18:14399:x1876361769746432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789438383.864618:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438383.864633:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c69e1600/0x7a8dd0fcbb925faa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb925fa3 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438383.864654:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c69e1600/0x7a8dd0fcbb925faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925fa3 expref: 19 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438383.864663:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c69e1600/0x7a8dd0fcbb925faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925fa3 expref: 19 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438383.864680:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c69e1600, rc 0) 00000100:00100000:2.0:1789438383.865362:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d080ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+19:14399:x1876361769746432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 757us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438383.865371:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789438383.865985:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769746432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789438383.866004:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991e0715e00/0x7a8dd0fcbb925fa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925faa expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438383.866044:0:14399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991e0715e00/0x7a8dd0fcbb925fa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb925faa expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438383.866097:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769746560:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789438383.866140:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438383.866178:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e1f4ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1789438383.866583:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769746560 00000100:00100000:2.0:1789438383.866591:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769746560 00000100:00100000:2.0:1789438383.866633:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789438383.866641:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d080a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+19:14399:x1876361769746560:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789438383.866658:0:14396:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789438383.866674:0:14396:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789438383.866677:0:14396:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1789438383.866795:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d080a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+19:14399:x1876361769746560:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 154us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438383.866802:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789438383.868666:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769746560:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789438383.868754:0:14399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789438383.868763:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991e0715e00/0x7a8dd0fcbb925fa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925faa expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438383.868773:0:14399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991e0715e00/0x7a8dd0fcbb925fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb925faa expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438384.055261:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438385.082400:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438386.104950:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789438386.491460:0:14433:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789438387.126828:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789438387.510921:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789438387.510927:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789438387.510930:0:36:0:(import.c:65:import_set_state_nolock()) ffff9991de19a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789438387.510945:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9991de19a800 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:1.0:1789438387.510965:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9991faab4000 x1876361769746944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789438387.511022:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876361769747072:0@lo:400:kworker.0 00000100:00100000:1.0:1789438387.511085:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438387.511137:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789438387.511151:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769747200:0@lo:400:kworker.0 00000100:00100000:1.0:1789438387.511176:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438387.511272:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3666e65-cb7a-452a-a637-b1a251df2a46:3309:1876361769746688:0@lo:400:kworker.0 00000100:00100000:2.0:1789438387.511308:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438387.511342:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876361769747328:0@lo:400:kworker.0 00000100:00100000:2.0:1789438387.511366:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438387.511383:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789438387.511389:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769746816:0@lo:400:kworker.0 00000100:00100000:2.0:1789438387.511424:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438387.511454:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876361769746944:0@lo:8:kworker.0 00000100:00100000:2.0:1789438387.511474:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438387.511520:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769747072 00000100:00100000:2.0:1789438387.511528:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769747072 00000100:00100000:2.0:1789438387.511578:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769747200 00000100:00100000:2.0:1789438387.511582:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769747200 00000100:00100000:2.0:1789438387.511605:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769747328 00000100:00100000:2.0:1789438387.511608:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769747328 00000100:00100000:2.0:1789438387.511621:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789438387.511628:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876361769747072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438387.511691:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876361769747072:12345-0@lo:400:kworker.0 Request processed in 62us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438387.511698:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789438387.511739:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789438387.511746:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769747200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438387.511774:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769747200:12345-0@lo:400:kworker.0 Request processed in 30us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438387.511779:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789438387.511789:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789438387.511795:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876361769747328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438387.511826:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876361769747328:12345-0@lo:400:kworker.0 Request processed in 31us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438387.511832:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789438387.511857:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769746816 00000100:00100000:2.0:1789438387.511861:0:15085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769746816 00000100:00100000:2.0:1789438387.511882:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769746944 00000100:00100000:2.0:1789438387.511886:0:15085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769746944 00000100:00100000:2.0:1789438387.511896:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789438387.511901:0:15085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769746816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438387.511930:0:15085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769746816:12345-0@lo:400:kworker.0 Request processed in 29us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438387.511935:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789438387.511955:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789438387.511958:0:15085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1876361769746944:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789438387.511981:0:15085:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:2.0:1789438387.512007:0:15085:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7a8dd0fcbb925fb1 00002000:00100000:2.0:1789438387.512019:0:15085:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9992017c4800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789438387.512023:0:15085:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789438387.512026:0:15085:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789438387.512332:0:15085:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789438387.512354:0:15085:0:(import.c:65:import_set_state_nolock()) ffff9992017c5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789438387.512392:0:15085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1876361769746944:12345-0@lo:8:kworker.0 Request processed in 432us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438387.512399:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1789438387.512422:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789438387.512426:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789438387.512454:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991faab4000 x1876361769746944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789438412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789438387.512469:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789438387.512476:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789438387.512481:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789438387.512483:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9991de19a800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789438387.512497:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789438387.512502:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876361769746944:0@lo:8:kworker.0 00000004:00080000:2.0:1789438387.512559:0:14426:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1789438387.512578:0:14426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3120380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14426:1876361769747584:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789438387.512606:0:14426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438387.512622:0:14426:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e751a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789438387.512643:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3123800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769747456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789438387.512670:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438387.512731:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769747456 00000100:00100000:2.0:1789438387.512735:0:15089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769747456 00000100:00100000:2.0:1789438387.512769:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789438387.512776:0:15089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1876361769747456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789438387.512794:0:15089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789438387.512831:0:15089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1876361769747456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438387.512838:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789438387.512854:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789438387.512869:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991c3123800 x1876361769747456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789438403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438387.512882:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3123800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769747456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789438387.512906:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769746816:0@lo:400:kworker.0 00010000:00080000:2.0:1789438387.512916:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991faab5f80 x1876361769747328/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438387.512925:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876361769747328:0@lo:400:kworker.0 00010000:00080000:2.0:1789438387.512954:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991faab4a80 x1876361769747200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438387.512963:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769747200:0@lo:400:kworker.0 00010000:00080000:2.0:1789438387.512973:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991faab4380 x1876361769747072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789438387.512980:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876361769747072:0@lo:400:kworker.0 00000100:00100000:2.0:1789438387.513006:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769747584 00000100:00100000:2.0:1789438387.513009:0:15085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769747584 00000100:00100000:2.0:1789438387.513030:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789438387.513036:0:15085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14426:x1876361769747584:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789438387.514554:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769746688 00000100:00100000:1.0:1789438387.514563:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769746688 00000100:00100000:1.0:1789438387.514606:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789438387.514614:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d0808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+19:3309:x1876361769746688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438387.514691:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d0808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+19:3309:x1876361769746688:12345-0@lo:400:kworker.0 Request processed in 78us (3381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438387.514697:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789438387.514767:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3666e65-cb7a-452a-a637-b1a251df2a46:3309:1876361769746688:0@lo:400:kworker.0 00000004:00080000:0.0:1789438387.517834:0:14425:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789438387.518284:0:14425:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 439783574759ns, next at 0ns, rc = 0 00002000:00080000:2.0:1789438387.530090:0:15085:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789438387.530102:0:15085:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1789438387.530108:0:15085:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:2.0:1789438387.550858:0:15085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789438387.550870:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb925fb8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.550887:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1789438387.550891:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789438387.550897:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb925fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.550917:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb925fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.550927:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb925fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.550935:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb925fb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.550958:0:15085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789438387.550974:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789438387.550986:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb925fb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.550994:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c69e1800 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:2.0:1789438387.550998:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb925fb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.551006:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb925fb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.551023:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb925fb8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.551030:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb925fb8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.551047:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438387.551048:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438387.551050:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789438387.571389:0:15085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789438387.571405:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925fbf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.571422:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1789438387.571426:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438387.571433:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925fbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.571450:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925fbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.571460:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925fbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.573356:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925fbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.574064:0:15085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789438387.574751:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789438387.574760:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925fbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.574771:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54200 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:3.0:1789438387.574776:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925fbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.574795:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925fbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.574816:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925fbf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.574823:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925fbf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.574843:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438387.574845:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438387.574846:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789438387.576266:0:15085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789438387.576278:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb925fc6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.576293:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1789438387.576297:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789438387.576303:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb925fc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.576327:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb925fc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.576337:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb925fc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.576344:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb925fc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.578977:0:15085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789438387.579797:0:15085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789438387.579806:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081a4930c/0x7a8dd0fcbb925fcd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.579822:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1789438387.579826:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789438387.579832:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081a4930c/0x7a8dd0fcbb925fcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.579844:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081a4930c/0x7a8dd0fcbb925fcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.579853:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081a4930c/0x7a8dd0fcbb925fcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.579871:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081a4930c/0x7a8dd0fcbb925fcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.592396:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789438387.592409:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb925fc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.592423:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c69e1800 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:3.0:1789438387.592427:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb925fc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.592439:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb925fc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.592458:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb925fc6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.592501:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb925fc6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.592628:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789438387.592633:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081a4930c/0x7a8dd0fcbb925fcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.592640:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c69e1400 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:3.0:1789438387.592643:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081a4930c/0x7a8dd0fcbb925fcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.592652:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081a4930c/0x7a8dd0fcbb925fcd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.592662:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081a4930c/0x7a8dd0fcbb925fcd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.592671:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438387.592672:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438387.592674:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438387.600239:0:15085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789438387.600263:0:15085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081a4930c/0x7a8dd0fcbb925fcd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.601639:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789438387.603157:0:15085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789438387.603168:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000853bc0a1/0x7a8dd0fcbb925fd4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.603184:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1789438387.603189:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789438387.603195:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000853bc0a1/0x7a8dd0fcbb925fd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.603209:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000853bc0a1/0x7a8dd0fcbb925fd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.603219:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000853bc0a1/0x7a8dd0fcbb925fd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.603228:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000853bc0a1/0x7a8dd0fcbb925fd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.603263:0:15085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789438387.604391:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789438387.604401:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000853bc0a1/0x7a8dd0fcbb925fd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.604412:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c69e1c00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:3.0:1789438387.604425:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000853bc0a1/0x7a8dd0fcbb925fd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.604435:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000853bc0a1/0x7a8dd0fcbb925fd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.604452:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000853bc0a1/0x7a8dd0fcbb925fd4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.604459:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000853bc0a1/0x7a8dd0fcbb925fd4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.604477:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438387.604479:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438387.604481:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789438387.606910:0:15085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789438387.606924:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925fdb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.606940:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1789438387.606944:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438387.606950:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925fdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.606966:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925fdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.606976:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925fdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.606990:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925fdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.607022:0:15085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789438387.611424:0:15085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789438387.611438:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb925fe2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.611455:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1789438387.611460:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438387.611466:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb925fe2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.611481:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb925fe2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.611635:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb925fe2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.611645:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb925fe2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.611666:0:15085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789438387.611988:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789438387.611996:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925fdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.612004:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54200 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:0.0:1789438387.612008:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925fdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.612017:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925fdb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.612035:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925fdb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.612042:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb925fdb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.612060:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789438387.612063:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb925fe2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.612070:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54400 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:0.0:1789438387.612072:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb925fe2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.612079:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb925fe2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.612114:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb925fe2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.612121:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb925fe2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.612133:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438387.612134:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438387.612136:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438387.613789:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789438387.615996:0:15085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789438387.616007:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb925fe9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.616028:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1789438387.616032:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438387.616038:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb925fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.616051:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb925fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.616061:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb925fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.616068:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb925fe9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.616157:0:15085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789438387.618885:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789438387.618898:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb925fe9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.618912:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54800 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:1.0:1789438387.618917:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb925fe9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.618928:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb925fe9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.618954:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb925fe9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.618963:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb925fe9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.619002:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438387.619003:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438387.619005:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789438387.626610:0:15085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789438387.626623:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ddd2e62/0x7a8dd0fcbb925ff0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.626640:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1789438387.626645:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438387.626651:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ddd2e62/0x7a8dd0fcbb925ff0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.626676:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ddd2e62/0x7a8dd0fcbb925ff0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.626700:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ddd2e62/0x7a8dd0fcbb925ff0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.626724:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ddd2e62/0x7a8dd0fcbb925ff0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.626870:0:15085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789438387.627323:0:15085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789438387.627329:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bc5a5db/0x7a8dd0fcbb925ff7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.627337:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1789438387.627341:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438387.627345:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bc5a5db/0x7a8dd0fcbb925ff7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.627355:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bc5a5db/0x7a8dd0fcbb925ff7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.627373:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bc5a5db/0x7a8dd0fcbb925ff7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.627380:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bc5a5db/0x7a8dd0fcbb925ff7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.627406:0:15085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789438387.627833:0:15085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789438387.627840:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be4afcdb/0x7a8dd0fcbb925ffe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.627850:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1789438387.627854:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438387.627858:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be4afcdb/0x7a8dd0fcbb925ffe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.627868:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be4afcdb/0x7a8dd0fcbb925ffe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.627877:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be4afcdb/0x7a8dd0fcbb925ffe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.627885:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be4afcdb/0x7a8dd0fcbb925ffe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.627893:0:15085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789438387.628296:0:15085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789438387.628302:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4bf839e/0x7a8dd0fcbb926005 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.628311:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1789438387.628320:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438387.628325:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4bf839e/0x7a8dd0fcbb926005 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.628335:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4bf839e/0x7a8dd0fcbb926005 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.628342:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4bf839e/0x7a8dd0fcbb926005 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.628349:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4bf839e/0x7a8dd0fcbb926005 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.628357:0:15085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1789438387.638842:0:15085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789438387.638855:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb92600c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.638873:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1789438387.638877:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438387.638884:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb92600c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.638899:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb92600c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.638910:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb92600c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.638926:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb92600c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.638938:0:15085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1789438387.639852:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789438387.639861:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ddd2e62/0x7a8dd0fcbb925ff0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.639871:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55a00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:1.0:1789438387.639876:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ddd2e62/0x7a8dd0fcbb925ff0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.639886:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ddd2e62/0x7a8dd0fcbb925ff0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.639903:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ddd2e62/0x7a8dd0fcbb925ff0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.639910:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ddd2e62/0x7a8dd0fcbb925ff0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.639929:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789438387.639933:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bc5a5db/0x7a8dd0fcbb925ff7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.639939:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55800 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:1.0:1789438387.639950:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bc5a5db/0x7a8dd0fcbb925ff7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.639958:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bc5a5db/0x7a8dd0fcbb925ff7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.639969:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bc5a5db/0x7a8dd0fcbb925ff7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.639975:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bc5a5db/0x7a8dd0fcbb925ff7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.639987:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789438387.639990:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be4afcdb/0x7a8dd0fcbb925ffe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.639997:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54000 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:1.0:1789438387.640000:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be4afcdb/0x7a8dd0fcbb925ffe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.640006:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be4afcdb/0x7a8dd0fcbb925ffe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.640014:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be4afcdb/0x7a8dd0fcbb925ffe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.640021:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be4afcdb/0x7a8dd0fcbb925ffe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.640040:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789438387.640043:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4bf839e/0x7a8dd0fcbb926005 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.640050:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54c00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:1.0:1789438387.640052:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4bf839e/0x7a8dd0fcbb926005 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.640059:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4bf839e/0x7a8dd0fcbb926005 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.640069:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4bf839e/0x7a8dd0fcbb926005 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.640076:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4bf839e/0x7a8dd0fcbb926005 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.641164:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789438387.641170:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb92600c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.641179:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54400 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:1.0:1789438387.641182:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb92600c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.641323:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb92600c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.641337:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb92600c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.641344:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb92600c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.641358:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438387.641825:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438387.641828:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789438387.641909:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1789438387.641936:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789438387.646724:0:15085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789438387.647594:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb926013 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.647612:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1789438387.647617:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438387.647623:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb926013 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.647638:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb926013 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.647648:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb926013 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.647656:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb926013 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.647682:0:15085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789438387.648350:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789438387.648365:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb926013 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.648375:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54200 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:1.0:1789438387.648379:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb926013 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.648388:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb926013 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.648404:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb926013 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.648419:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb926013 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.648444:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438387.648446:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438387.648447:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789438387.668967:0:15085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438387.668983:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f93a262e/0x7a8dd0fcbb92601a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.669001:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=439s v=(0 0) 00010000:00010000:1.0:1789438387.669006:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438387.669012:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f93a262e/0x7a8dd0fcbb92601a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.669026:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f93a262e/0x7a8dd0fcbb92601a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.669036:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f93a262e/0x7a8dd0fcbb92601a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.669045:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f93a262e/0x7a8dd0fcbb92601a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.669062:0:15085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789438387.670360:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789438387.670371:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f93a262e/0x7a8dd0fcbb92601a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.670382:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0715800 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:2.0:1789438387.670387:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f93a262e/0x7a8dd0fcbb92601a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.670399:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f93a262e/0x7a8dd0fcbb92601a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.670419:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f93a262e/0x7a8dd0fcbb92601a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.670426:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f93a262e/0x7a8dd0fcbb92601a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.670448:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438387.670450:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438387.670452:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789438387.673161:0:15085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438387.673179:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a4cf453/0x7a8dd0fcbb926021 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.673197:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=439s v=(0 0) 00010000:00010000:1.0:1789438387.673201:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438387.673207:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a4cf453/0x7a8dd0fcbb926021 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.673220:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a4cf453/0x7a8dd0fcbb926021 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.673231:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a4cf453/0x7a8dd0fcbb926021 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.673238:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a4cf453/0x7a8dd0fcbb926021 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.674366:0:15085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789438387.674584:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789438387.674593:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a4cf453/0x7a8dd0fcbb926021 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.674603:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0715c00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:2.0:1789438387.674614:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a4cf453/0x7a8dd0fcbb926021 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.674625:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a4cf453/0x7a8dd0fcbb926021 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.674645:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a4cf453/0x7a8dd0fcbb926021 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.674653:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a4cf453/0x7a8dd0fcbb926021 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.674686:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438387.674688:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438387.674690:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789438387.677587:0:15085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438387.677602:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000522f766d/0x7a8dd0fcbb926028 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.677619:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=439s v=(0 0) 00010000:00010000:1.0:1789438387.677623:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438387.677631:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000522f766d/0x7a8dd0fcbb926028 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.677644:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000522f766d/0x7a8dd0fcbb926028 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.677674:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000522f766d/0x7a8dd0fcbb926028 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.677683:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000522f766d/0x7a8dd0fcbb926028 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.677846:0:15085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789438387.678426:0:15085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438387.678433:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009778bcfa/0x7a8dd0fcbb92602f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.678443:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=439s v=(0 0) 00010000:00010000:1.0:1789438387.678446:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438387.678450:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009778bcfa/0x7a8dd0fcbb92602f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.678460:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009778bcfa/0x7a8dd0fcbb92602f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.678481:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009778bcfa/0x7a8dd0fcbb92602f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.678490:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009778bcfa/0x7a8dd0fcbb92602f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.684289:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789438387.684303:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000522f766d/0x7a8dd0fcbb926028 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.684317:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0715000 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:2.0:1789438387.684321:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000522f766d/0x7a8dd0fcbb926028 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.684332:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000522f766d/0x7a8dd0fcbb926028 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.684353:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000522f766d/0x7a8dd0fcbb926028 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.684376:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000522f766d/0x7a8dd0fcbb926028 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.684406:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789438387.684411:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009778bcfa/0x7a8dd0fcbb92602f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.684417:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0714400 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:2.0:1789438387.684421:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009778bcfa/0x7a8dd0fcbb92602f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.684429:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009778bcfa/0x7a8dd0fcbb92602f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.684439:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009778bcfa/0x7a8dd0fcbb92602f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.684447:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438387.684448:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438387.684450:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438387.689940:0:15085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789438387.689955:0:15085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009778bcfa/0x7a8dd0fcbb92602f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789438387.690682:0:15085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438387.690690:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026533e85/0x7a8dd0fcbb926036 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.690703:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=439s v=(0 0) 00010000:00010000:1.0:1789438387.692875:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438387.692889:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026533e85/0x7a8dd0fcbb926036 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.692911:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026533e85/0x7a8dd0fcbb926036 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.692924:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026533e85/0x7a8dd0fcbb926036 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.692931:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026533e85/0x7a8dd0fcbb926036 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.698679:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789438387.698694:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026533e85/0x7a8dd0fcbb926036 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.699014:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0714800 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:2.0:1789438387.699037:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026533e85/0x7a8dd0fcbb926036 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.699050:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026533e85/0x7a8dd0fcbb926036 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438387.699071:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026533e85/0x7a8dd0fcbb926036 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.699198:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438387.699200:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438387.699208:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438387.701015:0:15085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789438387.701028:0:15085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026533e85/0x7a8dd0fcbb926036 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.701694:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789438387.702276:0:15085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789438387.702285:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8024e75/0x7a8dd0fcbb92603d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.702300:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=439s v=(0 0) 00010000:00010000:1.0:1789438387.702305:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438387.702311:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8024e75/0x7a8dd0fcbb92603d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.702326:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8024e75/0x7a8dd0fcbb92603d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.702336:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8024e75/0x7a8dd0fcbb92603d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.702344:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8024e75/0x7a8dd0fcbb92603d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.702359:0:15085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789438387.703187:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789438387.703195:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8024e75/0x7a8dd0fcbb92603d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.703205:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0714a00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:3.0:1789438387.703210:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8024e75/0x7a8dd0fcbb92603d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.703220:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8024e75/0x7a8dd0fcbb92603d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.703236:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8024e75/0x7a8dd0fcbb92603d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.703244:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8024e75/0x7a8dd0fcbb92603d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.703262:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438387.703264:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438387.703266:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789438387.711554:0:15085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789438387.711567:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abb233a6/0x7a8dd0fcbb926044 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.711583:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1789438387.711588:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789438387.711594:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abb233a6/0x7a8dd0fcbb926044 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.711608:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abb233a6/0x7a8dd0fcbb926044 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.711617:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abb233a6/0x7a8dd0fcbb926044 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.711625:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abb233a6/0x7a8dd0fcbb926044 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.711670:0:15085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789438387.714253:0:15085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789438387.714265:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af47e669/0x7a8dd0fcbb92604b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.714280:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1789438387.714283:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789438387.714289:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af47e669/0x7a8dd0fcbb92604b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.714300:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af47e669/0x7a8dd0fcbb92604b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.714309:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af47e669/0x7a8dd0fcbb92604b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.714316:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af47e669/0x7a8dd0fcbb92604b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.714814:0:15085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789438387.715447:0:15085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789438387.715455:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c31873e8/0x7a8dd0fcbb926052 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.715467:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1789438387.715476:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789438387.715481:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c31873e8/0x7a8dd0fcbb926052 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.715492:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c31873e8/0x7a8dd0fcbb926052 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.715501:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c31873e8/0x7a8dd0fcbb926052 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.715508:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c31873e8/0x7a8dd0fcbb926052 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.720290:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789438387.720304:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abb233a6/0x7a8dd0fcbb926044 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.720317:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63600 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:1.0:1789438387.720323:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abb233a6/0x7a8dd0fcbb926044 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.720350:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abb233a6/0x7a8dd0fcbb926044 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.720370:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abb233a6/0x7a8dd0fcbb926044 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.720379:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abb233a6/0x7a8dd0fcbb926044 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.720402:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789438387.720406:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af47e669/0x7a8dd0fcbb92604b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.720412:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63000 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:1.0:1789438387.720415:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af47e669/0x7a8dd0fcbb92604b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.720423:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af47e669/0x7a8dd0fcbb92604b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.720433:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af47e669/0x7a8dd0fcbb92604b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.720440:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af47e669/0x7a8dd0fcbb92604b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.720464:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789438387.720481:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c31873e8/0x7a8dd0fcbb926052 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.720489:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63a00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:1.0:1789438387.720493:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c31873e8/0x7a8dd0fcbb926052 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.720501:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c31873e8/0x7a8dd0fcbb926052 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.720512:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c31873e8/0x7a8dd0fcbb926052 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.720519:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438387.720521:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438387.720523:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438387.729832:0:15085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789438387.729846:0:15085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c31873e8/0x7a8dd0fcbb926052 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789438387.730522:0:15085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789438387.730530:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a33d9fe/0x7a8dd0fcbb926059 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.730554:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1789438387.730558:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789438387.730564:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a33d9fe/0x7a8dd0fcbb926059 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.730578:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a33d9fe/0x7a8dd0fcbb926059 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.730596:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a33d9fe/0x7a8dd0fcbb926059 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.730604:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a33d9fe/0x7a8dd0fcbb926059 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.730615:0:15085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789438387.736987:0:15085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789438387.736999:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6d564b8/0x7a8dd0fcbb926060 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.737014:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=440s v=(0 0) 00010000:00010000:0.0:1789438387.737019:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789438387.737025:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6d564b8/0x7a8dd0fcbb926060 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.737041:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6d564b8/0x7a8dd0fcbb926060 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.737050:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6d564b8/0x7a8dd0fcbb926060 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.737058:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6d564b8/0x7a8dd0fcbb926060 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.737079:0:15085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789438387.737197:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789438387.737205:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a33d9fe/0x7a8dd0fcbb926059 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.737213:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63e00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:3.0:1789438387.737217:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a33d9fe/0x7a8dd0fcbb926059 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.737232:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a33d9fe/0x7a8dd0fcbb926059 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.737248:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a33d9fe/0x7a8dd0fcbb926059 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.737255:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a33d9fe/0x7a8dd0fcbb926059 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.737273:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789438387.737276:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6d564b8/0x7a8dd0fcbb926060 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.737282:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d62a00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:3.0:1789438387.737284:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6d564b8/0x7a8dd0fcbb926060 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.737290:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6d564b8/0x7a8dd0fcbb926060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.737299:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6d564b8/0x7a8dd0fcbb926060 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.737306:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6d564b8/0x7a8dd0fcbb926060 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.737330:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438387.737332:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438387.737333:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438387.742718:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789438387.751167:0:15085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789438387.751179:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb926067 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.751195:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=440s v=(0 0) 00010000:00010000:3.0:1789438387.751200:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438387.751207:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb926067 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.751222:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb926067 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.751233:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb926067 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.751240:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb926067 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.751300:0:15085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789438387.752444:0:15085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789438387.752452:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb92606e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.756294:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=440s v=(0 0) 00010000:00010000:3.0:1789438387.756299:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438387.756307:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb92606e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.756322:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb92606e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.756332:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb92606e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438387.756340:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb92606e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.757920:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789438387.757933:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb926067 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.757944:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54200 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:0.0:1789438387.757949:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb926067 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.757959:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb926067 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.757978:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb926067 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.757985:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028bd082c/0x7a8dd0fcbb926067 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.758011:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789438387.758015:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb92606e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.758021:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54400 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:0.0:1789438387.758024:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb92606e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.758054:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb92606e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.758065:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb92606e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438387.758071:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438387.758073:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789438387.758075:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438387.761676:0:15085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789438387.761689:0:15085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000939b6e06/0x7a8dd0fcbb92606e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438387.761873:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1789438387.762365:0:15085:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1789438387.762517:0:15085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14426:x1876361769747584:12345-0@lo:5:osp-pre-1-0.0 Request processed in 249476us (249906us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438387.762530:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789438387.774936:0:14426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3120380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14426:1876361769747584:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789438387.774959:0:14426:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1789438387.775012:0:14426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff938e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14426:1876361769747712:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789438387.775066:0:14426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438387.775123:0:14426:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991ff88d240 going to sleep for 11 seconds 00000100:00100000:3.0:1789438387.775201:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769747712 00000100:00100000:3.0:1789438387.775208:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769747712 00000100:00100000:3.0:1789438387.775266:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789438387.775275:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14426:x1876361769747712:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789438387.775333:0:15087:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1789438387.791395:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14426:x1876361769747712:12345-0@lo:5:osp-pre-1-0.0 Request processed in 16114us (16321us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789438387.791408:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789438387.799001:0:14426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff938e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14426:1876361769747712:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789438387.799023:0:14426:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000001:00080000:1.0:1789438388.127328:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1789438388.127638:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1789438388.156386:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438388.536105:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff93a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769747840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789438388.536175:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438388.537055:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769747840 00000100:00100000:2.0:1789438388.537064:0:15089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769747840 00000100:00100000:2.0:1789438388.537142:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789438388.537152:0:15089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769747840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789438388.537183:0:15089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789438388.537372:0:15089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769747840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 221us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438388.537380:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789438388.537595:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff93a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769747840:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789438389.174934:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438390.198808:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789438390.923374:0:16160:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg609-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789438391.233416:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438392.246917:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438392.631415:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789438392.631438:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff93a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769747968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789438392.631511:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438392.631749:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769747968 00000100:00100000:0.0:1789438392.631757:0:15090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769747968 00000100:00100000:0.0:1789438392.631813:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789438392.631831:0:15090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769747968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789438392.631862:0:15090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438392.631909:0:15090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769747968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438392.631931:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789438392.631973:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789438392.631993:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff93a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769747968:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789438392.632278:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789438392.632496:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3120a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876361769748480:0@lo:400:kworker.0 00000100:00100000:2.0:1789438392.632541:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438392.632571:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789438392.632577:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3121c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876361769748352:0@lo:400:kworker.0 00000100:00100000:2.0:1789438392.632598:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438392.632621:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769748480 00000100:00100000:2.0:1789438392.632626:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769748480 00000100:00100000:2.0:1789438392.632671:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769748352 00000100:00100000:2.0:1789438392.632675:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769748352 00000100:00100000:2.0:1789438392.632689:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789438392.632695:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876361769748480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438392.632851:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3666e65-cb7a-452a-a637-b1a251df2a46:3309:1876361769748096:0@lo:400:kworker.0 00000100:00100000:1.0:1789438392.632885:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438392.632918:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876361769748608:0@lo:400:kworker.0 00000100:00100000:1.0:1789438392.632944:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438392.632969:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789438392.632974:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769748224:0@lo:400:kworker.0 00000100:00100000:1.0:1789438392.632997:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438392.633317:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769748224 00000100:00100000:3.0:1789438392.633322:0:15085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769748224 00000100:00100000:3.0:1789438392.633364:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789438392.633371:0:15085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769748224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438392.633413:0:15085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769748224:12345-0@lo:400:kworker.0 Request processed in 44us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438392.633419:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789438392.633512:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876361769748480:12345-0@lo:400:kworker.0 Request processed in 816us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438392.633530:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789438392.633543:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769748608 00000100:00100000:2.0:1789438392.633546:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769748608 00000100:00100000:2.0:1789438392.633563:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789438392.633569:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876361769748352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438392.633597:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876361769748352:12345-0@lo:400:kworker.0 Request processed in 28us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438392.633603:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789438392.633614:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789438392.633621:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876361769748608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438392.633660:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876361769748608:12345-0@lo:400:kworker.0 Request processed in 39us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438392.633666:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789438392.633689:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769748096 00000100:00100000:2.0:1789438392.633692:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769748096 00000100:00100000:2.0:1789438392.633740:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789438392.633748:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d080b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+19:3309:x1876361769748096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438392.633784:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d080b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+19:3309:x1876361769748096:12345-0@lo:400:kworker.0 Request processed in 38us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438392.633791:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1789438392.633815:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789438392.633819:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789438392.635588:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991c3121c00 x1876361769748352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438392.635604:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3121c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876361769748352:0@lo:400:kworker.0 00010000:00080000:3.0:1789438392.635618:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991c3120a80 x1876361769748480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789438392.635626:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3120a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876361769748480:0@lo:400:kworker.0 00000100:00100000:1.0:1789438392.638733:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769748224:0@lo:400:kworker.0 00000100:00100000:1.0:1789438392.638753:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b3666e65-cb7a-452a-a637-b1a251df2a46:3309:1876361769748096:0@lo:400:kworker.0 00010000:00080000:1.0:1789438392.638769:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9991c3123480 x1876361769748608/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789438408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789438392.638780:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876361769748608:0@lo:400:kworker.0 00010000:00010000:3.0:1789438393.273528:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438393.642339:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438393.642371:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749830528 00000100:00100000:0.0:1789438393.642380:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749830528 00000100:00100000:0.0:1789438393.642416:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 74 00000100:00100000:0.0:1789438393.642424:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f5501050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2352:x1876361749830528:12345-192.168.206.9@tcp:250:mount.lustre.0 00010000:00080000:0.0:1789438393.642451:0:14395:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from de569208-d9a5-4940-b85b-d390a73b7b00@192.168.206.9@tcp t0 exp 0000000000000000 cur 445 last 0 00000020:00000080:0.0:1789438393.642475:0:14395:0:(genops.c:1384:class_connect()) connect: client de569208-d9a5-4940-b85b-d390a73b7b00, cookie 0x7a8dd0fcbb926075 00000100:00080000:0.0:1789438393.642613:0:14395:0:(import.c:65:import_set_state_nolock()) ffff9991c7de4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789438393.642674:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f5501050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de569208-d9a5-4940-b85b-d390a73b7b00+5:2352:x1876361749830528:12345-192.168.206.9@tcp:250:mount.lustre.0 Request processed in 248us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438393.642681:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 74 00000100:00100000:3.0:1789438393.651359:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438393.651389:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749830656 00000100:00100000:2.0:1789438393.651399:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749830656 00000100:00100000:2.0:1789438393.651444:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 75 00000100:00100000:2.0:1789438393.651455:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f5500450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de569208-d9a5-4940-b85b-d390a73b7b00+5:13744:x1876361749830656:12345-192.168.206.9@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789438393.651470:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438393.651486:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c69e1a00/0x7a8dd0fcbb92607c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x483b483084eaa555 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438393.651526:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c69e1a00/0x7a8dd0fcbb92607c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa555 expref: 6 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438393.651538:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c69e1a00/0x7a8dd0fcbb92607c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa555 expref: 6 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438393.651548:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c69e1a00, rc 0) 00000100:00100000:2.0:1789438393.651613:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f5500450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de569208-d9a5-4940-b85b-d390a73b7b00+6:13744:x1876361749830656:12345-192.168.206.9@tcp:101:mount.lustre.0 Request processed in 159us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438393.651620:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 75 00000100:00100000:1.0:1789438393.656703:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789438393.656744:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769748736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789438393.656808:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438393.657244:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769748736 00000100:00100000:0.0:1789438393.657252:0:15090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769748736 00000100:00100000:0.0:1789438393.657304:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789438393.657313:0:15090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769748736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789438393.657343:0:15090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438393.657396:0:15090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769748736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438393.657402:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789438393.657529:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769748736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789438393.660789:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438393.660890:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749830784 00000100:00100000:2.0:1789438393.660899:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749830784 00000100:00100000:2.0:1789438393.660940:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 76 00000100:00100000:2.0:1789438393.660949:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f5503c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de569208-d9a5-4940-b85b-d390a73b7b00+6:13744:x1876361749830784:12345-192.168.206.9@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789438393.661212:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f5503c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de569208-d9a5-4940-b85b-d390a73b7b00+6:13744:x1876361749830784:12345-192.168.206.9@tcp:501:mount.lustre.0 Request processed in 263us (431us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789438393.661221:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 76 00000100:00100000:3.0:1789438393.676210:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438393.676386:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749830912 00000100:00100000:0.0:1789438393.676395:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749830912 00000100:00100000:0.0:1789438393.676467:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 77 00000100:00100000:0.0:1789438393.676477:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f5500c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de569208-d9a5-4940-b85b-d390a73b7b00+6:13744:x1876361749830912:12345-192.168.206.9@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789438393.676494:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438393.676520:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991f3d63a00/0x7a8dd0fcbb926083 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x483b483084eaa55c expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438393.676560:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991f3d63a00/0x7a8dd0fcbb926083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa55c expref: 7 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438393.676573:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991f3d63a00/0x7a8dd0fcbb926083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa55c expref: 7 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438393.676583:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63a00, rc 0) 00000100:00100000:0.0:1789438393.676655:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f5500c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de569208-d9a5-4940-b85b-d390a73b7b00+7:13744:x1876361749830912:12345-192.168.206.9@tcp:101:mount.lustre.0 Request processed in 178us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438393.676661:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 77 00000100:00100000:0.0:1789438393.683849:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438393.687021:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749831040 00000100:00100000:1.0:1789438393.687038:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749831040 00000100:00100000:1.0:1789438393.687106:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 78 00000100:00100000:1.0:1789438393.687117:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f5503050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de569208-d9a5-4940-b85b-d390a73b7b00+7:13744:x1876361749831040:12345-192.168.206.9@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789438393.687402:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f5503050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de569208-d9a5-4940-b85b-d390a73b7b00+8:13744:x1876361749831040:12345-192.168.206.9@tcp:501:mount.lustre.0 Request processed in 286us (3565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438393.687410:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 78 00000100:00100000:2.0:1789438393.689386:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438393.689833:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749831168 00000100:00100000:0.0:1789438393.689842:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749831168 00000100:00100000:0.0:1789438393.689893:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 79 00000100:00100000:0.0:1789438393.689902:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f5502450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de569208-d9a5-4940-b85b-d390a73b7b00+8:13744:x1876361749831168:12345-192.168.206.9@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789438393.690111:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f5502450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de569208-d9a5-4940-b85b-d390a73b7b00+8:13744:x1876361749831168:12345-192.168.206.9@tcp:503:mount.lustre.0 Request processed in 208us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438393.690119:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 79 00000100:00100000:3.0:1789438393.703500:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438393.704043:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749831296 00000100:00100000:2.0:1789438393.704055:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749831296 00000100:00100000:2.0:1789438393.704113:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 80 00000100:00100000:2.0:1789438393.704124:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f5501850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de569208-d9a5-4940-b85b-d390a73b7b00+8:13762:x1876361749831296:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789438393.704397:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f5501850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de569208-d9a5-4940-b85b-d390a73b7b00+8:13762:x1876361749831296:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 275us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438393.704405:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 80 00000100:00100000:3.0:1789438393.737834:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438393.740386:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749831424 00000100:00100000:1.0:1789438393.740400:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749831424 00000100:00100000:1.0:1789438393.740456:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 81 00000100:00100000:1.0:1789438393.740466:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f5500850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de569208-d9a5-4940-b85b-d390a73b7b00+8:13762:x1876361749831424:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789438393.740790:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f5500850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de569208-d9a5-4940-b85b-d390a73b7b00+8:13762:x1876361749831424:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 324us (2964us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438393.740797:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 81 00000100:00100000:3.0:1789438393.756143:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438393.756320:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749831552 00000100:00100000:0.0:1789438393.756331:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749831552 00000100:00100000:0.0:1789438393.756386:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 82 00000100:00100000:0.0:1789438393.756396:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f5501450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de569208-d9a5-4940-b85b-d390a73b7b00+8:13744:x1876361749831552:12345-192.168.206.9@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789438393.756419:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438393.756435:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991f3d62a00/0x7a8dd0fcbb92608a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x483b483084eaa586 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438393.756465:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991f3d62a00/0x7a8dd0fcbb92608a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa586 expref: 9 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438393.756477:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991f3d62a00/0x7a8dd0fcbb92608a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa586 expref: 9 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438393.756486:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d62a00, rc 0) 00000100:00100000:0.0:1789438393.756561:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f5501450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de569208-d9a5-4940-b85b-d390a73b7b00+9:13744:x1876361749831552:12345-192.168.206.9@tcp:101:mount.lustre.0 Request processed in 166us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438393.756569:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 82 00000100:00100000:3.0:1789438393.762095:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438393.762332:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749831680 00000100:00100000:2.0:1789438393.762342:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749831680 00000100:00100000:2.0:1789438393.762397:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 83 00000100:00100000:2.0:1789438393.762407:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f5502850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de569208-d9a5-4940-b85b-d390a73b7b00+9:13744:x1876361749831680:12345-192.168.206.9@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789438393.762432:0:14396:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789438393.762459:0:14396:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789438393.762463:0:14396:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789438393.762466:0:14396:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789438393.762469:0:14396:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1789438393.764231:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f5502850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de569208-d9a5-4940-b85b-d390a73b7b00+9:13744:x1876361749831680:12345-192.168.206.9@tcp:256:mount.lustre.0 Request processed in 1818us (2137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438393.764243:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 83 00000100:00100000:3.0:1789438393.767313:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438393.767413:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749831808 00000100:00100000:0.0:1789438393.767423:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749831808 00000100:00100000:0.0:1789438393.767482:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 84 00000100:00100000:0.0:1789438393.767491:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f5503450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de569208-d9a5-4940-b85b-d390a73b7b00+9:13744:x1876361749831808:12345-192.168.206.9@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789438393.767520:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438393.767542:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991f3d63e00/0x7a8dd0fcbb926091 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x483b483084eaa58d expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438393.767571:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991f3d63e00/0x7a8dd0fcbb926091 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa58d expref: 10 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438393.767603:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991f3d63e00/0x7a8dd0fcbb926091 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa58d expref: 10 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438393.767612:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d63e00, rc 0) 00000100:00100000:0.0:1789438393.767685:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f5503450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de569208-d9a5-4940-b85b-d390a73b7b00+10:13744:x1876361749831808:12345-192.168.206.9@tcp:101:mount.lustre.0 Request processed in 195us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438393.767693:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 84 00000100:00100000:3.0:1789438393.772685:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438393.773035:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749831936 00000100:00100000:0.0:1789438393.773047:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749831936 00000100:00100000:0.0:1789438393.773107:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 85 00000100:00100000:0.0:1789438393.773116:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de569208-d9a5-4940-b85b-d390a73b7b00+10:13744:x1876361749831936:12345-192.168.206.9@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789438393.773379:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de569208-d9a5-4940-b85b-d390a73b7b00+10:13744:x1876361749831936:12345-192.168.206.9@tcp:501:mount.lustre.0 Request processed in 262us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438393.773388:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 85 00000100:00100000:2.0:1789438393.776144:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438393.776365:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749832064 00000100:00100000:0.0:1789438393.776374:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749832064 00000100:00100000:0.0:1789438393.776425:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 86 00000100:00100000:0.0:1789438393.776435:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de569208-d9a5-4940-b85b-d390a73b7b00+10:13744:x1876361749832064:12345-192.168.206.9@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789438393.777083:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de569208-d9a5-4940-b85b-d390a73b7b00+10:13744:x1876361749832064:12345-192.168.206.9@tcp:503:mount.lustre.0 Request processed in 647us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438393.777093:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 86 00000100:00100000:3.0:1789438393.781051:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438393.781149:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749832192 00000100:00100000:0.0:1789438393.781159:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749832192 00000100:00100000:0.0:1789438393.781213:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 87 00000100:00100000:0.0:1789438393.781222:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de569208-d9a5-4940-b85b-d390a73b7b00+10:13767:x1876361749832192:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789438393.781532:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de569208-d9a5-4940-b85b-d390a73b7b00+10:13767:x1876361749832192:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 310us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438393.781540:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 87 00000100:00100000:0.0:1789438393.790411:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438393.790532:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749832320 00000100:00100000:1.0:1789438393.790544:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749832320 00000100:00100000:1.0:1789438393.790608:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 88 00000100:00100000:1.0:1789438393.790619:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de569208-d9a5-4940-b85b-d390a73b7b00+10:13767:x1876361749832320:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789438393.790911:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de569208-d9a5-4940-b85b-d390a73b7b00+10:13767:x1876361749832320:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 293us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438393.790919:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 88 00000100:00100000:2.0:1789438393.809656:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438393.810306:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749832448 00000100:00100000:0.0:1789438393.810316:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749832448 00000100:00100000:0.0:1789438393.810365:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:0.0:1789438393.810373:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2352:x1876361749832448:12345-192.168.206.9@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789438393.810400:0:14402:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 95f713a9-b8bf-4da8-a40a-409f87b2a8ff@192.168.206.9@tcp t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:0.0:1789438393.810455:0:14402:0:(genops.c:1384:class_connect()) connect: client 95f713a9-b8bf-4da8-a40a-409f87b2a8ff, cookie 0x7a8dd0fcbb926098 00000004:00100000:0.0:1789438393.810482:0:14402:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:0.0:1789438393.810488:0:14402:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1789438393.866241:0:14402:0:(import.c:65:import_set_state_nolock()) ffff9991c80f8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789438393.866317:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+6:2352:x1876361749832448:12345-192.168.206.9@tcp:38:mount.lustre.0 Request processed in 55942us (56670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438393.866331:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:3.0:1789438393.868987:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438393.869245:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749832704 00000100:00100000:2.0:1789438393.869254:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749832704 00000100:00100000:2.0:1789438393.869327:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 5 00000100:00100000:2.0:1789438393.869338:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+6:13744:x1876361749832704:12345-192.168.206.9@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789438393.869392:0:14403:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789438393.869485:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+6:13744:x1876361749832704:12345-192.168.206.9@tcp:41:mount.lustre.0 Request processed in 149us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438393.869493:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 5 00000100:00080000:3.0:1789438393.870178:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789438393.871988:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438393.872074:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749832832 00000100:00100000:1.0:1789438393.872083:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749832832 00000100:00100000:1.0:1789438393.872137:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 6 00000100:00100000:1.0:1789438393.872147:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+6:13744:x1876361749832832:12345-192.168.206.9@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789438393.872224:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+6:13744:x1876361749832832:12345-192.168.206.9@tcp:40:mount.lustre.0 Request processed in 79us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438393.872232:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 6 00000100:00100000:3.0:1789438393.875241:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438393.875344:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438393.875369:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438393.875398:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749832960 00000100:00100000:3.0:1789438393.875407:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749832960 00000100:00100000:3.0:1789438393.875455:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749833088 00000100:00100000:3.0:1789438393.875459:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749833088 00000100:00100000:3.0:1789438393.875474:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 8 00000100:00100000:3.0:1789438393.875481:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1876361749832960:12345-192.168.206.9@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789438393.875521:0:15087:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 95f713a9-b8bf-4da8-a40a-409f87b2a8ff@192.168.206.9@tcp t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:3.0:1789438393.875553:0:15087:0:(genops.c:1384:class_connect()) connect: client 95f713a9-b8bf-4da8-a40a-409f87b2a8ff, cookie 0x7a8dd0fcbb92609f 00002000:00100000:3.0:1789438393.875566:0:15087:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 95f713a9-b8bf-4da8-a40a-409f87b2a8ff/ffff9991f64e3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789438393.875576:0:15087:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:3.0:1789438393.876131:0:15087:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789438393.876160:0:15087:0:(import.c:65:import_set_state_nolock()) ffff9991f64e4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789438393.876220:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+6:2352:x1876361749832960:12345-192.168.206.9@tcp:8:mount.lustre.0 Request processed in 736us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438393.876227:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 8 00000100:00100000:3.0:1789438393.876248:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:3.0:1789438393.876253:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1876361749833088:12345-192.168.206.9@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789438393.876269:0:15087:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 95f713a9-b8bf-4da8-a40a-409f87b2a8ff@192.168.206.9@tcp t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:3.0:1789438393.876301:0:15087:0:(genops.c:1384:class_connect()) connect: client 95f713a9-b8bf-4da8-a40a-409f87b2a8ff, cookie 0x7a8dd0fcbb9260a6 00002000:00100000:3.0:1789438393.876306:0:15087:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 95f713a9-b8bf-4da8-a40a-409f87b2a8ff/ffff9991f64e7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789438393.876322:0:15087:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:3.0:1789438393.876526:0:15087:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789438393.876542:0:15087:0:(import.c:65:import_set_state_nolock()) ffff9991f64e0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789438393.876568:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+6:2352:x1876361749833088:12345-192.168.206.9@tcp:8:mount.lustre.0 Request processed in 313us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438393.876575:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:3.0:1789438393.879627:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438393.879932:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749832576 00000100:00100000:2.0:1789438393.879943:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749832576 00000100:00100000:2.0:1789438393.880008:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:2.0:1789438393.880018:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+6:0:x1876361749832576:12345-192.168.206.9@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789438393.880050:0:14401:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789438393.880119:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+6:0:x1876361749832576:12345-192.168.206.9@tcp:41:mount.lustre.0 Request processed in 103us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438393.880126:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:1.0:1789438393.881732:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749833216 00000100:00100000:1.0:1789438393.881821:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749833216 00000100:00100000:1.0:1789438393.882090:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00100000:1.0:1789438393.882101:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+6:13744:x1876361749833216:12345-192.168.206.9@tcp:33:mount.lustre.0 00000004:00080000:1.0:1789438393.883972:0:14404:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1801us 00000004:00200000:0.0:1789438393.895567:0:14404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789438393.895692:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+6:13744:x1876361749833216:12345-192.168.206.9@tcp:33:mount.lustre.0 Request processed in 13587us (20453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438393.895704:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00100000:2.0:1789438394.112500:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438394.112989:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749833344 00000100:00100000:0.0:1789438394.112999:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749833344 00000100:00100000:1.0:1789438394.113179:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 8 00000100:00100000:1.0:1789438394.113191:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+6:13788:x1876361749833344:12345-192.168.206.9@tcp:101:mkdir.0 00010000:00010000:1.0:1789438394.113211:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438394.113234:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714200/0x7a8dd0fcbb9260ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa5b7 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438394.113294:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb9260b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438394.113307:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb9260b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438394.113320:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb9260b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438394.113353:0:14403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789438394.113357:0:14403:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789438394.113391:0:14403:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb9260b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438394.113431:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714200/0x7a8dd0fcbb9260ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa5b7 expref: 8 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438394.113450:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb9260b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa5b7 expref: 7 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438394.113458:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991c3e2d200) 00010000:00010000:1.0:1789438394.113472:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789438394.113475:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e0715200, rc 0) 00000100:00100000:1.0:1789438394.113543:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+7:13788:x1876361749833344:12345-192.168.206.9@tcp:101:mkdir.0 Request processed in 354us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438394.113551:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 8 00010000:00010000:1.0:1789438394.294878:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438395.319152:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438396.227060:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438396.227185:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749833472 00000100:00100000:0.0:1789438396.227195:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749833472 00000100:00080000:1.0:1789438396.227306:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789438396.235016:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:0.0:1789438396.235040:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+7:13841:x1876361749833472:12345-192.168.206.9@tcp:41:lfs.0 00000004:00000024:0.0:1789438396.235085:0:14402:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789438396.235186:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+7:13841:x1876361749833472:12345-192.168.206.9@tcp:41:lfs.0 Request processed in 157us (8133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438396.235195:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:3.0:1789438396.241892:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438396.241977:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749833600 00000100:00100000:0.0:1789438396.241987:0:15090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749833600 00000100:00100000:0.0:1789438396.242073:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 6 00000100:00100000:0.0:1789438396.242084:0:15090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+6:13841:x1876361749833600:12345-192.168.206.9@tcp:13:lfs.0 00002000:00000024:0.0:1789438396.242119:0:15090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438396.242195:0:15090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+6:13841:x1876361749833600:12345-192.168.206.9@tcp:13:lfs.0 Request processed in 113us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438396.242203:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 6 00000100:00080000:3.0:1789438396.242478:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789438396.245356:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438396.245552:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749833728 00000100:00100000:0.0:1789438396.245562:0:15090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749833728 00000100:00080000:3.0:1789438396.245676:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789438396.245750:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:0.0:1789438396.245760:0:15090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+6:13841:x1876361749833728:12345-192.168.206.9@tcp:13:lfs.0 00002000:00000024:0.0:1789438396.245795:0:15090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438396.246046:0:15090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+6:13841:x1876361749833728:12345-192.168.206.9@tcp:13:lfs.0 Request processed in 287us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438396.246054:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 7 00010000:00010000:1.0:1789438396.343072:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438396.478241:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438396.478329:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749833856 00000100:00100000:0.0:1789438396.478338:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749833856 00000100:00100000:0.0:1789438396.478396:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 89 00000100:00100000:0.0:1789438396.478406:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de569208-d9a5-4940-b85b-d390a73b7b00+10:13876:x1876361749833856:12345-192.168.206.9@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789438396.478422:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438396.478439:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991f3d62e00/0x7a8dd0fcbb9260bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x483b483084eaa5be expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438396.478467:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991f3d62e00/0x7a8dd0fcbb9260bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa5be expref: 11 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438396.478507:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991f3d62e00/0x7a8dd0fcbb9260bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa5be expref: 11 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438396.478516:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d62e00, rc 0) 00000100:00100000:0.0:1789438396.478576:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de569208-d9a5-4940-b85b-d390a73b7b00+11:13876:x1876361749833856:12345-192.168.206.9@tcp:101:mount.lustre.0 Request processed in 171us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438396.478584:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 89 00000100:00100000:3.0:1789438396.481701:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438396.481815:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749833984 00000100:00100000:2.0:1789438396.481824:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749833984 00000100:00100000:2.0:1789438396.481887:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 90 00000100:00100000:2.0:1789438396.481897:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de569208-d9a5-4940-b85b-d390a73b7b00+11:13876:x1876361749833984:12345-192.168.206.9@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789438396.482389:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de569208-d9a5-4940-b85b-d390a73b7b00+11:13876:x1876361749833984:12345-192.168.206.9@tcp:501:mount.lustre.0 Request processed in 491us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438396.482398:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 90 00000100:00100000:2.0:1789438396.492305:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438396.492446:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749834112 00000100:00100000:1.0:1789438396.492455:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749834112 00000100:00100000:1.0:1789438396.492518:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 91 00000100:00100000:1.0:1789438396.492528:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de569208-d9a5-4940-b85b-d390a73b7b00+11:13876:x1876361749834112:12345-192.168.206.9@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789438396.492770:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de569208-d9a5-4940-b85b-d390a73b7b00+11:13876:x1876361749834112:12345-192.168.206.9@tcp:503:mount.lustre.0 Request processed in 243us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438396.492778:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 91 00000100:00100000:0.0:1789438396.498749:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438396.499281:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749834240 00000100:00100000:2.0:1789438396.499304:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749834240 00000100:00100000:2.0:1789438396.499350:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 92 00000100:00100000:2.0:1789438396.499359:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de569208-d9a5-4940-b85b-d390a73b7b00+11:13881:x1876361749834240:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789438396.499646:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de569208-d9a5-4940-b85b-d390a73b7b00+11:13881:x1876361749834240:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 287us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438396.499655:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 92 00000100:00100000:3.0:1789438396.513599:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438396.513698:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749834368 00000100:00100000:0.0:1789438396.513740:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749834368 00000100:00100000:0.0:1789438396.513795:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 93 00000100:00100000:0.0:1789438396.513805:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de569208-d9a5-4940-b85b-d390a73b7b00+11:13881:x1876361749834368:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789438396.514073:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de569208-d9a5-4940-b85b-d390a73b7b00+11:13881:x1876361749834368:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 269us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438396.514082:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 93 00000100:00100000:3.0:1789438396.517647:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438396.520019:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749834496 00000100:00100000:1.0:1789438396.520032:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749834496 00000100:00100000:1.0:1789438396.520253:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 94 00000100:00100000:1.0:1789438396.520264:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de569208-d9a5-4940-b85b-d390a73b7b00+11:13876:x1876361749834496:12345-192.168.206.9@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789438396.520280:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438396.520297:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991e0715a00/0x7a8dd0fcbb9260c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x483b483084eaa5e8 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438396.520322:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991e0715a00/0x7a8dd0fcbb9260c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa5e8 expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438396.520333:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991e0715a00/0x7a8dd0fcbb9260c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa5e8 expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438396.520355:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e0715a00, rc 0) 00000100:00100000:1.0:1789438396.520420:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de569208-d9a5-4940-b85b-d390a73b7b00+12:13876:x1876361749834496:12345-192.168.206.9@tcp:101:mount.lustre.0 Request processed in 157us (2781us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438396.523128:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 94 00000100:00100000:1.0:1789438396.526327:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438396.526742:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749834624 00000100:00100000:2.0:1789438396.526752:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749834624 00000100:00100000:2.0:1789438396.526800:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 95 00000100:00100000:2.0:1789438396.526810:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de569208-d9a5-4940-b85b-d390a73b7b00+12:13876:x1876361749834624:12345-192.168.206.9@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789438396.526831:0:14394:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789438396.526862:0:14394:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789438396.526866:0:14394:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789438396.526869:0:14394:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789438396.526872:0:14394:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789438396.536212:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de569208-d9a5-4940-b85b-d390a73b7b00+12:13876:x1876361749834624:12345-192.168.206.9@tcp:256:mount.lustre.0 Request processed in 9392us (9883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438396.536226:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 95 00000100:00100000:3.0:1789438396.540541:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438396.540799:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749834752 00000100:00100000:0.0:1789438396.540809:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749834752 00000100:00100000:0.0:1789438396.541310:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 96 00000100:00100000:0.0:1789438396.541322:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de569208-d9a5-4940-b85b-d390a73b7b00+12:13876:x1876361749834752:12345-192.168.206.9@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789438396.541340:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438396.541357:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991f3d62c00/0x7a8dd0fcbb9260c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x483b483084eaa5ef expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438396.541385:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991f3d62c00/0x7a8dd0fcbb9260c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa5ef expref: 13 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438396.541415:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991f3d62c00/0x7a8dd0fcbb9260c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa5ef expref: 13 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438396.541436:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d62c00, rc 0) 00000100:00100000:0.0:1789438396.541494:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de569208-d9a5-4940-b85b-d390a73b7b00+13:13876:x1876361749834752:12345-192.168.206.9@tcp:101:mount.lustre.0 Request processed in 174us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438396.541512:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 96 00000100:00100000:1.0:1789438396.543997:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438396.544207:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749834880 00000100:00100000:2.0:1789438396.544216:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749834880 00000100:00100000:2.0:1789438396.544267:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 97 00000100:00100000:2.0:1789438396.544281:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de569208-d9a5-4940-b85b-d390a73b7b00+13:13876:x1876361749834880:12345-192.168.206.9@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789438396.545826:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de569208-d9a5-4940-b85b-d390a73b7b00+13:13876:x1876361749834880:12345-192.168.206.9@tcp:501:mount.lustre.0 Request processed in 1539us (1829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438396.546190:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 97 00000100:00100000:3.0:1789438396.547722:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438396.547947:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749835008 00000100:00100000:0.0:1789438396.547955:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749835008 00000100:00100000:0.0:1789438396.548004:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 98 00000100:00100000:0.0:1789438396.548012:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de569208-d9a5-4940-b85b-d390a73b7b00+13:13876:x1876361749835008:12345-192.168.206.9@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789438396.548274:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de569208-d9a5-4940-b85b-d390a73b7b00+13:13876:x1876361749835008:12345-192.168.206.9@tcp:503:mount.lustre.0 Request processed in 261us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438396.548282:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 98 00000100:00100000:3.0:1789438396.550564:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438396.550725:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749835136 00000100:00100000:2.0:1789438396.550743:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749835136 00000100:00100000:2.0:1789438396.550845:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 99 00000100:00100000:2.0:1789438396.550855:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de569208-d9a5-4940-b85b-d390a73b7b00+13:13885:x1876361749835136:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789438396.551069:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de569208-d9a5-4940-b85b-d390a73b7b00+13:13885:x1876361749835136:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 215us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438396.551077:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 99 00000100:00100000:2.0:1789438396.560453:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438396.560554:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749835264 00000100:00100000:1.0:1789438396.560563:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749835264 00000100:00100000:1.0:1789438396.560626:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 100 00000100:00100000:1.0:1789438396.560636:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de569208-d9a5-4940-b85b-d390a73b7b00+13:13885:x1876361749835264:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789438396.560900:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de569208-d9a5-4940-b85b-d390a73b7b00+13:13885:x1876361749835264:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 265us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438396.560908:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 100 00000100:00100000:3.0:1789438396.569385:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438396.569434:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438396.569466:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438396.569510:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438396.569544:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749835904 00000100:00100000:3.0:1789438396.569553:0:15085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749835904 00000100:00100000:3.0:1789438396.569596:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749836032 00000100:00100000:3.0:1789438396.569599:0:15085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749836032 00000100:00100000:3.0:1789438396.569615:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 3 00000100:00100000:3.0:1789438396.569648:0:15085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+6:2354:x1876361749835904:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438396.569743:0:15085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+6:2354:x1876361749835904:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 97us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438396.569751:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 3 00000100:00100000:3.0:1789438396.569768:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:3.0:1789438396.569775:0:15085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+6:2354:x1876361749836032:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438396.569800:0:15085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+6:2354:x1876361749836032:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 26us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438396.569806:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:2.0:1789438396.569942:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749835392 00000100:00100000:2.0:1789438396.569946:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749835392 00000100:00100000:2.0:1789438396.569974:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749835776 00000100:00100000:2.0:1789438396.569977:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749835776 00000100:00100000:2.0:1789438396.569997:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 14 00000100:00100000:2.0:1789438396.570003:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+7:2354:x1876361749835776:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789438396.570039:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+7:2354:x1876361749835776:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 36us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438396.570045:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 14 00000100:00100000:2.0:1789438396.570059:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:2.0:1789438396.570064:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2352:x1876361749835392:12345-192.168.206.9@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789438396.570087:0:14401:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from bfb3eacc-1e1b-434b-806a-250616f742cf@192.168.206.9@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:2.0:1789438396.570124:0:14401:0:(genops.c:1384:class_connect()) connect: client bfb3eacc-1e1b-434b-806a-250616f742cf, cookie 0x7a8dd0fcbb9260d0 00000004:00100000:2.0:1789438396.570155:0:14401:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:2.0:1789438396.570264:0:14401:0:(import.c:65:import_set_state_nolock()) ffff9992017c7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789438396.570292:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfb3eacc-1e1b-434b-806a-250616f742cf+6:2352:x1876361749835392:12345-192.168.206.9@tcp:38:mount.lustre.0 Request processed in 226us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438396.570300:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:3.0:1789438396.572487:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438396.572644:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438396.573199:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749835520 00000100:00100000:2.0:1789438396.573221:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749835520 00000100:00100000:2.0:1789438396.573319:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749835648 00000100:00100000:2.0:1789438396.573323:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749835648 00000100:00100000:2.0:1789438396.573342:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 11 00000100:00100000:2.0:1789438396.573351:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9990c26e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfb3eacc-1e1b-434b-806a-250616f742cf+7:0:x1876361749835520:12345-192.168.206.9@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789438396.573379:0:14401:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789438396.573450:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9990c26e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfb3eacc-1e1b-434b-806a-250616f742cf+7:0:x1876361749835520:12345-192.168.206.9@tcp:41:mount.lustre.0 Request processed in 100us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438396.573458:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 11 00000100:00100000:2.0:1789438396.573477:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 12 00000100:00100000:2.0:1789438396.573485:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfb3eacc-1e1b-434b-806a-250616f742cf+6:13876:x1876361749835648:12345-192.168.206.9@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789438396.573508:0:14401:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789438396.573532:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfb3eacc-1e1b-434b-806a-250616f742cf+6:13876:x1876361749835648:12345-192.168.206.9@tcp:41:mount.lustre.0 Request processed in 48us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438396.573539:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 12 00000100:00080000:3.0:1789438396.575703:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789438396.577468:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438396.577543:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749836160 00000100:00100000:3.0:1789438396.577553:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749836160 00000100:00100000:3.0:1789438396.577609:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:3.0:1789438396.577619:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfb3eacc-1e1b-434b-806a-250616f742cf+6:13876:x1876361749836160:12345-192.168.206.9@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789438396.578100:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfb3eacc-1e1b-434b-806a-250616f742cf+6:13876:x1876361749836160:12345-192.168.206.9@tcp:40:mount.lustre.0 Request processed in 480us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438396.578108:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:1.0:1789438396.580339:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438396.580380:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438396.580452:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749836544 00000100:00100000:0.0:1789438396.580462:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749836544 00000100:00100000:0.0:1789438396.580529:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 1 00000100:00100000:0.0:1789438396.580540:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfb3eacc-1e1b-434b-806a-250616f742cf+6:13876:x1876361749836544:12345-192.168.206.9@tcp:33:mount.lustre.0 00000100:00100000:1.0:1789438396.580603:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000004:00200000:0.0:1789438396.580620:0:14405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789438396.580696:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfb3eacc-1e1b-434b-806a-250616f742cf+6:13876:x1876361749836544:12345-192.168.206.9@tcp:33:mount.lustre.0 Request processed in 156us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438396.580705:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 1 00000100:00100000:3.0:1789438396.583189:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749836288 00000100:00100000:3.0:1789438396.583203:0:15085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749836288 00000100:00100000:1.0:1789438396.583342:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749836416 00000100:00100000:1.0:1789438396.583348:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749836416 00000100:00100000:1.0:1789438396.583371:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:1.0:1789438396.583379:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1876361749836288:12345-192.168.206.9@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789438396.583546:0:15088:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from bfb3eacc-1e1b-434b-806a-250616f742cf@192.168.206.9@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:1.0:1789438396.583648:0:15088:0:(genops.c:1384:class_connect()) connect: client bfb3eacc-1e1b-434b-806a-250616f742cf, cookie 0x7a8dd0fcbb9260d7 00002000:00100000:1.0:1789438396.583661:0:15088:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bfb3eacc-1e1b-434b-806a-250616f742cf/ffff9991fa636000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789438396.583672:0:15088:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:1.0:1789438396.583794:0:15088:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789438396.583821:0:15088:0:(import.c:65:import_set_state_nolock()) ffff9991fa637800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789438396.584005:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfb3eacc-1e1b-434b-806a-250616f742cf+6:2352:x1876361749836288:12345-192.168.206.9@tcp:8:mount.lustre.0 Request processed in 624us (3623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438396.584013:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:1.0:1789438396.584032:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 11 00000100:00100000:1.0:1789438396.584036:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1876361749836416:12345-192.168.206.9@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789438396.584065:0:15088:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from bfb3eacc-1e1b-434b-806a-250616f742cf@192.168.206.9@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:1.0:1789438396.584081:0:15088:0:(genops.c:1384:class_connect()) connect: client bfb3eacc-1e1b-434b-806a-250616f742cf, cookie 0x7a8dd0fcbb9260de 00002000:00100000:1.0:1789438396.584086:0:15088:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bfb3eacc-1e1b-434b-806a-250616f742cf/ffff9991ff9bf000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789438396.584092:0:15088:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1789438396.584143:0:15088:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789438396.584157:0:15088:0:(import.c:65:import_set_state_nolock()) ffff9991ff9b8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789438396.584182:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfb3eacc-1e1b-434b-806a-250616f742cf+6:2352:x1876361749836416:12345-192.168.206.9@tcp:8:mount.lustre.0 Request processed in 143us (3579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438396.584189:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 11 00000040:00080000:2.0:1789438396.727438:0:14433:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789438396.728558:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438396.733330:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749836672 00000100:00100000:0.0:1789438396.733345:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749836672 00000100:00100000:0.0:1789438396.733512:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 14 00000100:00100000:0.0:1789438396.733539:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfb3eacc-1e1b-434b-806a-250616f742cf+6:13906:x1876361749836672:12345-192.168.206.9@tcp:101:mkdir.0 00010000:00010000:0.0:1789438396.733558:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438396.733580:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9260e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa619 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438396.733636:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb9260ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438396.733648:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb9260ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438396.733661:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb9260ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438396.733692:0:14402:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789438396.733695:0:14402:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789438396.733743:0:14402:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb9260ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438396.733767:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9260e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa619 expref: 8 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438396.733785:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb9260ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa619 expref: 7 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438396.733793:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991c3e2d200) 00010000:00010000:0.0:1789438396.733796:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789438396.733800:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d62400, rc 0) 00000100:00100000:0.0:1789438396.733859:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfb3eacc-1e1b-434b-806a-250616f742cf+7:13906:x1876361749836672:12345-192.168.206.9@tcp:101:mkdir.0 Request processed in 322us (5306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438396.733875:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 14 00010000:00010000:2.0:1789438397.367699:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438397.751061:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3666e65-cb7a-452a-a637-b1a251df2a46:3311:1876361769748864:0@lo:400:kworker.0 00000100:00100000:1.0:1789438397.751142:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438397.751200:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769749376:0@lo:400:kworker.0 00000100:00100000:1.0:1789438397.751231:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438397.751259:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789438397.751267:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769748992:0@lo:400:kworker.0 00000100:00100000:1.0:1789438397.751295:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438397.751319:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769749504:0@lo:400:kworker.0 00000100:00100000:1.0:1789438397.751353:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438397.752159:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769749120:0@lo:400:kworker.0 00000100:00100000:1.0:1789438397.752202:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438397.752236:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789438397.752244:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991faab6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769749248:0@lo:400:kworker.0 00000100:00100000:1.0:1789438397.752266:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438397.752299:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769749376 00000100:00100000:1.0:1789438397.752306:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769749376 00000100:00100000:1.0:1789438397.752348:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769749504 00000100:00100000:1.0:1789438397.752352:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769749504 00000100:00100000:1.0:1789438397.752365:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769749248 00000100:00100000:1.0:1789438397.752367:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769749248 00000100:00100000:1.0:1789438397.752394:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789438397.752403:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991faab6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769749376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438397.752925:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991faab6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769749376:12345-0@lo:400:kworker.0 Request processed in 385us (1557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438397.752935:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789438397.752957:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789438397.752964:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769749504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438397.752995:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769749504:12345-0@lo:400:kworker.0 Request processed in 32us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438397.753001:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789438397.753312:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789438397.753320:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769749248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438397.753358:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876361769749248:12345-0@lo:400:kworker.0 Request processed in 39us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438397.753659:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769748864 00000100:00100000:2.0:1789438397.753666:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769748864 00000100:00100000:2.0:1789438397.753722:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789438397.753730:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+19:3311:x1876361769748864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438397.753771:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+19:3311:x1876361769748864:12345-0@lo:400:kworker.0 Request processed in 42us (2631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438397.753777:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789438397.754758:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789438397.754788:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769748992 00000100:00100000:1.0:1789438397.754793:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769748992 00000100:00100000:1.0:1789438397.754827:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769749120 00000100:00100000:1.0:1789438397.754830:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769749120 00000100:00100000:1.0:1789438397.754845:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789438397.754852:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769748992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438397.754900:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769748992:12345-0@lo:400:kworker.0 Request processed in 49us (3607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438397.754906:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789438397.754917:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789438397.754923:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f3d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769749120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438397.754951:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f3d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769749120:12345-0@lo:400:kworker.0 Request processed in 29us (2751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438397.754956:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789438397.755043:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789438397.755056:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff93a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769749632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789438397.755569:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438397.755660:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876361769749248:0@lo:400:kworker.0 00000100:00100000:1.0:1789438397.755672:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769749120:0@lo:400:kworker.0 00000100:00100000:1.0:1789438397.755722:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769748992:0@lo:400:kworker.0 00000100:00100000:1.0:1789438397.755737:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769749504:0@lo:400:kworker.0 00000100:00100000:1.0:1789438397.755749:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3666e65-cb7a-452a-a637-b1a251df2a46:3311:1876361769748864:0@lo:400:kworker.0 00000100:00100000:1.0:1789438397.755759:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991faab7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769749376:0@lo:400:kworker.0 00000100:00100000:2.0:1789438397.755924:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769749632 00000100:00100000:2.0:1789438397.755935:0:15089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769749632 00000100:00100000:2.0:1789438397.756061:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789438397.756070:0:15089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769749632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789438397.756114:0:15089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789438397.756179:0:15089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769749632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438397.756186:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789438397.756264:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff93a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769749632:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789438397.756435:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789438397.756441:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789438397.756444:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1789438398.348036:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bfb3eacc-1e1b-434b-806a-250616f742cf 00000001:00100000:1.0:1789438398.348052:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 95f713a9-b8bf-4da8-a40a-409f87b2a8ff 00010000:00010000:1.0:1789438398.392456:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438398.776749:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3120a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769749760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789438398.776829:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438398.779631:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769749760 00000100:00100000:0.0:1789438398.779646:0:15090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769749760 00000100:00100000:0.0:1789438398.779735:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789438398.779746:0:15090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769749760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789438398.779791:0:15090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438398.779866:0:15090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769749760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (3036us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438398.779873:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789438398.782051:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3120a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769749760:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1789438398.883270:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bfb3eacc-1e1b-434b-806a-250616f742cf 00000001:00100000:0.0:1789438398.883293:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 95f713a9-b8bf-4da8-a40a-409f87b2a8ff 00000001:00100000:3.0:1789438399.350236:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 95f713a9-b8bf-4da8-a40a-409f87b2a8ff 00000001:00100000:3.0:1789438399.350252:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bfb3eacc-1e1b-434b-806a-250616f742cf 00010000:00010000:3.0:1789438399.415816:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789438399.997157:0:16366:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789438400.438876:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438401.465667:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438402.009873:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438402.009914:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438402.009946:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438402.009968:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438402.009986:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438402.010001:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438402.010017:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438402.010044:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749836800 00000100:00100000:3.0:1789438402.010052:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749836800 00000100:00100000:3.0:1789438402.010092:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 102 00000100:00100000:3.0:1789438402.010101:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de569208-d9a5-4940-b85b-d390a73b7b00+13:2353:x1876361749836800:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438402.010167:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de569208-d9a5-4940-b85b-d390a73b7b00+13:2353:x1876361749836800:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 67us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438402.010174:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 102 00000100:00100000:3.0:1789438402.010203:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749837184 00000100:00100000:3.0:1789438402.010206:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749837184 00000100:00100000:3.0:1789438402.010232:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749837440 00000100:00100000:3.0:1789438402.010234:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749837440 00000100:00100000:3.0:1789438402.010245:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749837056 00000100:00100000:3.0:1789438402.010247:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749837056 00000100:00100000:3.0:1789438402.010255:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749837568 00000100:00100000:3.0:1789438402.010257:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749837568 00000100:00100000:3.0:1789438402.010268:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:3.0:1789438402.010273:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+5:2353:x1876361749837184:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438402.010297:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+5:2353:x1876361749837184:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 24us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438402.010318:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:3.0:1789438402.010345:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 8 00000100:00100000:3.0:1789438402.010351:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa645f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfb3eacc-1e1b-434b-806a-250616f742cf+5:2353:x1876361749837440:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438402.010374:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa645f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfb3eacc-1e1b-434b-806a-250616f742cf+5:2353:x1876361749837440:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 24us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438402.010379:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 8 00000100:00100000:3.0:1789438402.010389:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:3.0:1789438402.010394:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa645180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+5:2353:x1876361749837056:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438402.011145:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749836928 00000100:00100000:1.0:1789438402.011152:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749836928 00000100:00100000:1.0:1789438402.011201:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749837312 00000100:00100000:1.0:1789438402.011204:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749837312 00000100:00100000:1.0:1789438402.011226:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 18 00000100:00100000:1.0:1789438402.011233:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+6:2353:x1876361749836928:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438402.011271:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+6:2353:x1876361749836928:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 39us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438402.011277:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 18 00000100:00100000:1.0:1789438402.011305:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 19 00000100:00100000:1.0:1789438402.011312:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfb3eacc-1e1b-434b-806a-250616f742cf+6:2353:x1876361749837312:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438402.011337:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfb3eacc-1e1b-434b-806a-250616f742cf+6:2353:x1876361749837312:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 26us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438402.011343:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 19 00000100:00100000:1.0:1789438402.011362:0:15085:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789438402.011369:0:15085:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789438402.011519:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:1.0:1789438402.011544:0:15085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfb3eacc-1e1b-434b-806a-250616f742cf+5:2353:x1876361749837568:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438402.011572:0:15085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfb3eacc-1e1b-434b-806a-250616f742cf+5:2353:x1876361749837568:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 41us (1553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438402.011578:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00080000:2.0:1789438402.012106:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789438402.012112:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789438402.012115:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789438402.012924:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa645180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+5:2353:x1876361749837056:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 2523us (2930us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438402.012935:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 9 00010000:00010000:1.0:1789438402.486816:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438402.871637:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3121c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3666e65-cb7a-452a-a637-b1a251df2a46:3311:1876361769749888:0@lo:400:kworker.0 00000100:00100000:2.0:1789438402.871756:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438402.871806:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991facb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769750400:0@lo:400:kworker.0 00000100:00100000:2.0:1789438402.871833:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438402.871859:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789438402.871866:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769750016:0@lo:400:kworker.0 00000100:00100000:3.0:1789438402.872088:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991c3120a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769750144:0@lo:400:kworker.0 00000100:00100000:2.0:1789438402.873748:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438402.873789:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991facb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769750528:0@lo:400:kworker.0 00000100:00100000:2.0:1789438402.873817:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438402.873853:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991facb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876361769750272:0@lo:400:kworker.0 00000100:00100000:2.0:1789438402.873877:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438402.873911:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769749888 00000100:00100000:2.0:1789438402.873919:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769749888 00000100:00100000:2.0:1789438402.873965:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789438402.873973:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+19:3311:x1876361769749888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438402.874111:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438402.874240:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+19:3311:x1876361769749888:12345-0@lo:400:kworker.0 Request processed in 266us (2533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438402.874261:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789438402.874294:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769750400 00000100:00100000:2.0:1789438402.874298:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769750400 00000100:00100000:2.0:1789438402.874326:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769750528 00000100:00100000:2.0:1789438402.874328:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769750528 00000100:00100000:2.0:1789438402.874340:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769750272 00000100:00100000:2.0:1789438402.874342:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769750272 00000100:00100000:2.0:1789438402.874354:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789438402.874360:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769750400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438402.874393:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876361769750400:12345-0@lo:400:kworker.0 Request processed in 33us (2560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438402.874399:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789438402.874410:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789438402.874416:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769750528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438402.874451:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769750016 00000100:00100000:2.0:1789438402.874452:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769750528:12345-0@lo:400:kworker.0 Request processed in 36us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438402.874457:0:15085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769750016 00000100:00100000:2.0:1789438402.874462:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789438402.874487:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789438402.874496:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876361769750272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438402.874522:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769750144 00000100:00100000:1.0:1789438402.874527:0:15085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769750144 00000100:00100000:2.0:1789438402.874532:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876361769750272:12345-0@lo:400:kworker.0 Request processed in 38us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438402.874539:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789438402.874558:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789438402.874567:0:15085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769750016:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789438402.874571:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789438402.874577:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789438402.874580:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789438402.874609:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991facb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876361769750272:0@lo:400:kworker.0 00000100:00100000:1.0:1789438402.874615:0:15085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769750016:12345-0@lo:400:kworker.0 Request processed in 47us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438402.874626:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789438402.874643:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789438402.874652:0:15085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa646680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769750144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438402.874689:0:15085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa646680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769750144:12345-0@lo:400:kworker.0 Request processed in 40us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438402.874696:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789438402.874774:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3120a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769750144:0@lo:400:kworker.0 00000100:00100000:3.0:1789438402.874956:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3121c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b3666e65-cb7a-452a-a637-b1a251df2a46:3311:1876361769749888:0@lo:400:kworker.0 00000100:00100000:3.0:1789438402.874969:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991facb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876361769750400:0@lo:400:kworker.0 00000100:00100000:3.0:1789438402.874990:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991c3120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769750016:0@lo:400:kworker.0 00000100:00100000:3.0:1789438402.875005:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991facb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769750528:0@lo:400:kworker.0 00000100:00100000:3.0:1789438402.878462:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769750656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789438402.878803:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438402.879488:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769750656 00000100:00100000:0.0:1789438402.879497:0:15090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769750656 00000100:00100000:0.0:1789438402.880049:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789438402.880060:0:15090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769750656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789438402.880095:0:15090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438402.880165:0:15090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769750656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (1363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438402.880172:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789438402.880251:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769750656:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789438403.513809:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789438403.635753:0:16515:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcce624350 20000000:00000080:3.0:1789438403.635780:0:16515:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9990c26e3c00 uarg=0000000000000000 20000000:01000000:3.0:1789438403.635823:0:16515:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789438403.635830:0:16515:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789438403.635835:0:16515:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789438403.637256:0:16516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1789438403.637526:0:16515:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789438403.651799:0:16515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789438403.652036:0:16515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9991f3d63600/0x7a8dd0fcbb9260f3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438403.652056:0:16515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991c69e0a00/0x7a8dd0fcbb925dea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925de3 expref: 18 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438403.652063:0:16515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991f3d63400/0x7a8dd0fcbb925e37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925e30 expref: 18 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438403.652089:0:16515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991c2a55e00/0x7a8dd0fcbb925f72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb925f6b expref: 18 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438403.652098:0:16515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991f3d63e00/0x7a8dd0fcbb926091 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa58d expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438403.652106:0:16515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9991f3d62c00/0x7a8dd0fcbb9260c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa5ef expref: 12 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438403.652113:0:16515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9991f3d63600/0x7a8dd0fcbb9260f3 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438403.652154:0:16515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991f3d62c00/0x7a8dd0fcbb9260c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa5ef expref: 12 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438403.652169:0:16515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9991f3d62c00/0x7a8dd0fcbb9260c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa5ef expref: 12 pid: 14396 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438403.652184:0:16515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff938e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1876361769750784:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438403.652596:0:16515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991f3d63e00/0x7a8dd0fcbb926091 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa58d expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438403.652606:0:16515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9991f3d63e00/0x7a8dd0fcbb926091 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa58d expref: 12 pid: 14395 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438403.652623:0:16515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff93a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1876361769750912:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438403.652663:0:16515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991c2a55e00/0x7a8dd0fcbb925f72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb925f6b expref: 18 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438403.652684:0:16515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9991c2a55e00/0x7a8dd0fcbb925f72 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb925f6b expref: 18 pid: 14396 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438403.652693:0:16515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff93aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1876361769751040:0@lo:104: 00000100:00100000:0.0:1789438403.652780:0:16515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789438403.652830:0:16515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991f3d63400/0x7a8dd0fcbb925e37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb925e30 expref: 18 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438403.652838:0:16515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9991f3d63400/0x7a8dd0fcbb925e37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb925e30 expref: 18 pid: 14395 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438403.652847:0:16515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff939c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1876361769751168:0@lo:104: 00000100:00100000:0.0:1789438403.652870:0:16515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789438403.652893:0:16515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9991c69e0a00/0x7a8dd0fcbb925dea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7a8dd0fcbb925de3 expref: 18 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438403.652903:0:16515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9991c69e0a00/0x7a8dd0fcbb925dea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7a8dd0fcbb925de3 expref: 18 pid: 14394 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438403.652913:0:16515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff938a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1876361769751296:0@lo:104: 00000100:00100000:1.0:1789438403.653019:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769751040 00000100:00100000:1.0:1789438403.653027:0:14385:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769751040 00000100:00100000:1.0:1789438403.653074:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769751168 00000100:00100000:1.0:1789438403.653079:0:14385:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769751168 00000100:00100000:2.0:1789438403.653099:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789438403.653120:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff93b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3666e65-cb7a-452a-a637-b1a251df2a46+4:16515:x1876361769751040:12345-0@lo:104: 00010000:00010000:2.0:1789438403.653142:0:14386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9991e0715600/0x7a8dd0fcbb925f6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb925f72 expref: -99 pid: 15804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438403.659669:0:16515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438403.659802:0:14385:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789438403.659828:0:14385:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1789438403.659834:0:14385:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:0.0:1789438403.660082:0:16515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9990c13859c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789438403.662187:0:14386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789438403.662209:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff93b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3666e65-cb7a-452a-a637-b1a251df2a46+4:16515:x1876361769751040:12345-0@lo:104: Request processed in 9091us (9422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438403.662223:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789438403.662269:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769751296 00010000:00010000:1.0:1789438403.662428:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789438403.662440:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991e0715600/0x7a8dd0fcbb925f6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb925f72 expref: -99 pid: 15804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438403.662452:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0715600 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:1.0:1789438403.662457:0:14390:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991e0715600/0x7a8dd0fcbb925f6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb925f72 expref: -99 pid: 15804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438403.662480:0:14390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991e0715600/0x7a8dd0fcbb925f6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb925f72 expref: -99 pid: 15804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789438403.662489:0:14390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991e0715600/0x7a8dd0fcbb925f6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb925f72 expref: -99 pid: 15804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789438403.662495:0:14390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789438403.662556:0:14390:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991e0715600/0x7a8dd0fcbb925f6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb925f72 expref: -99 pid: 15804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438403.662563:0:14390:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789438403.662591:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991e0715600/0x7a8dd0fcbb925f6b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb925f72 expref: -99 pid: 15804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438403.662598:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991e0715600/0x7a8dd0fcbb925f6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb925f72 expref: -99 pid: 15804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438403.662614:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438403.662616:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789438403.662618:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438403.662665:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769751296 00000100:00100000:2.0:1789438403.662741:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789438403.662752:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff93b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3666e65-cb7a-452a-a637-b1a251df2a46+4:16515:x1876361769751168:12345-0@lo:104: 00010000:00010000:2.0:1789438403.662764:0:14386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9991ff9dae00/0x7a8dd0fcbb925e30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb925e37 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438403.662824:0:14386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789438403.662830:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff93b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3666e65-cb7a-452a-a637-b1a251df2a46+4:16515:x1876361769751168:12345-0@lo:104: Request processed in 82us (9960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438403.662836:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789438403.662850:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789438403.662857:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ffaa8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3666e65-cb7a-452a-a637-b1a251df2a46+3:16515:x1876361769751296:12345-0@lo:104: 00010000:00010000:2.0:1789438403.662865:0:14386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9991f3d62000/0x7a8dd0fcbb925de3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb925dea expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438403.662894:0:14386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789438403.662916:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ffaa8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b3666e65-cb7a-452a-a637-b1a251df2a46+3:16515:x1876361769751296:12345-0@lo:104: Request processed in 60us (3253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438403.662922:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789438403.662979:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3666e65-cb7a-452a-a637-b1a251df2a46:3310:1876361769751424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789438403.663026:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438403.663064:0:16515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff93aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1876361769751040:0@lo:104: 00000100:00100000:0.0:1789438403.663087:0:16515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff939c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1876361769751168:0@lo:104: 00010000:00010000:2.0:1789438403.663092:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789438403.663100:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991ff9dae00/0x7a8dd0fcbb925e30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb925e37 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438403.663102:0:16515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff938a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1876361769751296:0@lo:104: 00010000:00010000:2.0:1789438403.663115:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991ff9dae00 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:2.0:1789438403.663120:0:14391:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991ff9dae00/0x7a8dd0fcbb925e30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb925e37 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438403.663126:0:14391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991ff9dae00/0x7a8dd0fcbb925e30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb925e37 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789438403.663136:0:14391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991ff9dae00/0x7a8dd0fcbb925e30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb925e37 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789438403.663142:0:14391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789438403.663170:0:14391:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991ff9dae00/0x7a8dd0fcbb925e30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb925e37 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438403.663176:0:14391:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789438403.663212:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991ff9dae00/0x7a8dd0fcbb925e30 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb925e37 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438403.663219:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991ff9dae00/0x7a8dd0fcbb925e30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb925e37 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438403.663242:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789438403.663245:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9991f3d62000/0x7a8dd0fcbb925de3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7a8dd0fcbb925dea expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438403.663251:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d62000 already unused, calling callback (ffffffffc1b57c20) 10000000:00010000:2.0:1789438403.663254:0:14391:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9991f3d62000/0x7a8dd0fcbb925de3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7a8dd0fcbb925dea expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438403.663261:0:14391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9991f3d62000/0x7a8dd0fcbb925de3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7a8dd0fcbb925dea expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789438403.663267:0:14391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9991f3d62000/0x7a8dd0fcbb925de3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7a8dd0fcbb925dea expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789438403.663272:0:14391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789438403.663603:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438403.663695:0:14391:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9991f3d62000/0x7a8dd0fcbb925de3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb925dea expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438403.663704:0:14391:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789438403.663739:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9991f3d62000/0x7a8dd0fcbb925de3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb925dea expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438403.663746:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9991f3d62000/0x7a8dd0fcbb925de3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7a8dd0fcbb925dea expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438403.663763:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438403.663765:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789438403.663767:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789438403.663788:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769751424 00000100:00100000:2.0:1789438403.663801:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769751424 00010000:00010000:2.0:1789438403.663830:0:14387:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991c2a55e00/0x7a8dd0fcbb925f72 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb925f6b expref: 19 pid: 14396 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438403.663858:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789438403.663865:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3666e65-cb7a-452a-a637-b1a251df2a46+19:3310:x1876361769751424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789438403.663879:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438403.663884:0:14387:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991c2a55e00/0x7a8dd0fcbb925f72 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb925f6b expref: 19 pid: 14396 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438403.663894:0:14387:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991c2a55e00/0x7a8dd0fcbb925f72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb925f6b expref: 19 pid: 14396 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438403.663908:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c2a55e00/0x7a8dd0fcbb925f72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb925f6b expref: 19 pid: 14396 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438403.663923:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789438403.663973:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3666e65-cb7a-452a-a637-b1a251df2a46+18:3310:x1876361769751424:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438403.663981:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789438403.664013:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991facb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3666e65-cb7a-452a-a637-b1a251df2a46:3312:1876361769751680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789438403.664050:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438403.664094:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769751680 00000100:00100000:3.0:1789438403.664107:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769751680 00000100:00100000:2.0:1789438403.664107:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789438403.664116:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991facb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3666e65-cb7a-452a-a637-b1a251df2a46:3312:1876361769751552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789438403.664147:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789438403.664176:0:14388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991c69e0a00/0x7a8dd0fcbb925dea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb925de3 expref: 18 pid: 14394 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438403.664181:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769751552 00000100:00100000:2.0:1789438403.664189:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769751552 00000100:00100000:3.0:1789438403.664215:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789438403.664215:0:14389:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991f3d63400/0x7a8dd0fcbb925e37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb925e30 expref: 19 pid: 14395 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438403.664234:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3666e65-cb7a-452a-a637-b1a251df2a46+19:3312:x1876361769751680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789438403.664261:0:14388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789438403.664271:0:14389:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789438403.664299:0:14389:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1789438403.664356:0:14388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991c69e0a00/0x7a8dd0fcbb925dea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb925de3 expref: 19 pid: 14394 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438403.664368:0:14388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991c69e0a00/0x7a8dd0fcbb925dea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb925de3 expref: 19 pid: 14394 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438403.664385:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991c69e0a00/0x7a8dd0fcbb925dea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb925de3 expref: 19 pid: 14394 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438403.664483:0:14388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789438403.664507:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3666e65-cb7a-452a-a637-b1a251df2a46:3310:1876361769751424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789438403.664540:0:14387:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789438403.664552:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789438403.664563:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c80c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3666e65-cb7a-452a-a637-b1a251df2a46+18:3312:x1876361769751552:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789438403.664572:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3666e65-cb7a-452a-a637-b1a251df2a46+18:3312:x1876361769751680:12345-0@lo:103:ldlm_bl.0 Request processed in 337us (516us total) trans 0 rc 0/0 00010000:00010000:2.0:1789438403.664581:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789438403.664588:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789438403.664593:0:14387:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991f3d63400/0x7a8dd0fcbb925e37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7a8dd0fcbb925e30 expref: 18 pid: 14395 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438403.664606:0:14387:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991f3d63400/0x7a8dd0fcbb925e37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7a8dd0fcbb925e30 expref: 17 pid: 14395 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438403.664622:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991f3d63400/0x7a8dd0fcbb925e37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7a8dd0fcbb925e30 expref: 17 pid: 14395 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438403.664636:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789438403.664638:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991facb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3666e65-cb7a-452a-a637-b1a251df2a46:3312:1876361769751680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789438403.664684:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c80c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b3666e65-cb7a-452a-a637-b1a251df2a46+16:3312:x1876361769751552:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438403.664692:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789438403.664697:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991facb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b3666e65-cb7a-452a-a637-b1a251df2a46:3312:1876361769751552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789438403.666171:0:16515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff938e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1876361769750784:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789438403.666200:0:16515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff93a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1876361769750912:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789438403.666231:0:16515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9991f3d63600/0x7a8dd0fcbb9260f3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438403.672993:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438403.673831:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438403.677160:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749837696 00000100:00100000:0.0:1789438403.677174:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749837696 00010000:00010000:0.0:1789438403.677235:0:14388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991f3d62c00/0x7a8dd0fcbb9260c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa5ef expref: 13 pid: 14396 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438403.677414:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749837824 00000100:00100000:0.0:1789438403.677419:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749837824 00010000:00010000:0.0:1789438403.677435:0:14388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9991f3d63e00/0x7a8dd0fcbb926091 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa58d expref: 14 pid: 14395 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438403.677458:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:0.0:1789438403.677481:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de569208-d9a5-4940-b85b-d390a73b7b00+14:2353:x1876361749837696:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789438403.677495:0:14388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438403.677501:0:14388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991f3d62c00/0x7a8dd0fcbb9260c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa5ef expref: 14 pid: 14396 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438403.677509:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 8 00010000:00010000:0.0:1789438403.677513:0:14388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991f3d62c00/0x7a8dd0fcbb9260c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa5ef expref: 14 pid: 14396 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438403.677518:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de569208-d9a5-4940-b85b-d390a73b7b00+14:2353:x1876361749837824:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789438403.677525:0:14389:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438403.677530:0:14389:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9991f3d63e00/0x7a8dd0fcbb926091 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa58d expref: 14 pid: 14395 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438403.677530:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991f3d62c00/0x7a8dd0fcbb9260c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa5ef expref: 14 pid: 14396 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438403.677539:0:14389:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9991f3d63e00/0x7a8dd0fcbb926091 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa58d expref: 13 pid: 14395 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438403.677547:0:14388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789438403.677549:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991f3d63e00/0x7a8dd0fcbb926091 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa58d expref: 13 pid: 14395 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438403.677560:0:14389:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9991f3d63600/0x7a8dd0fcbb9260f3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438403.677567:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991f3d63600/0x7a8dd0fcbb9260f3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438403.677580:0:14389:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9991f3d63600/0x7a8dd0fcbb9260f3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438403.677599:0:14389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9991f3d63600/0x7a8dd0fcbb9260f3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438403.677606:0:14389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9991f3d63600/0x7a8dd0fcbb9260f3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438403.677625:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9991f3d63600/0x7a8dd0fcbb9260f3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438403.677633:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63600 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:3.0:1789438403.677758:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9991f3d63600/0x7a8dd0fcbb9260f3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438403.677768:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9991f3d63600/0x7a8dd0fcbb9260f3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438403.677781:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9991f3d63600/0x7a8dd0fcbb9260f3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438403.677791:0:14389:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789438403.677855:0:16515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9991f3d63600/0x7a8dd0fcbb9260f3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438403.677863:0:16515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9991f3d63600/0x7a8dd0fcbb9260f3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438403.677870:0:16515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9991f3d63600/0x7a8dd0fcbb9260f3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438403.677879:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de569208-d9a5-4940-b85b-d390a73b7b00+12:2353:x1876361749837696:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 399us (4894us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438403.677886:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:3.0:1789438403.679664:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de569208-d9a5-4940-b85b-d390a73b7b00+11:2353:x1876361749837824:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 2137us (5825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438403.679675:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 8 00000100:00100000:0.0:1789438403.894983:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769751808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789438403.895049:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438403.895123:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769751808 00000100:00100000:0.0:1789438403.895131:0:15089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769751808 00000100:00100000:0.0:1789438403.895178:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789438403.895200:0:15089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769751808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789438403.895230:0:15089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438403.895285:0:15089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769751808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438403.895292:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789438403.895916:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769751808:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789438404.538893:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438405.021157:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438405.021228:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749837952 00000100:00100000:1.0:1789438405.021238:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749837952 00000100:00100000:1.0:1789438405.021291:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 104 00000100:00100000:1.0:1789438405.021300:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de569208-d9a5-4940-b85b-d390a73b7b00+11:13758:x1876361749837952:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789438405.021315:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438405.021333:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991e0714600/0x7a8dd0fcbb9260fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x483b483084eaa620 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438405.021358:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991e0714600/0x7a8dd0fcbb9260fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa620 expref: 12 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438405.021368:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991e0714600/0x7a8dd0fcbb9260fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa620 expref: 12 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438405.021376:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e0714600, rc 0) 00000100:00100000:1.0:1789438405.021426:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de569208-d9a5-4940-b85b-d390a73b7b00+12:13758:x1876361749837952:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 Request processed in 127us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438405.021444:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 104 00000100:00100000:2.0:1789438405.027836:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438405.027920:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749838080 00000100:00100000:3.0:1789438405.027931:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749838080 00000100:00100000:3.0:1789438405.027988:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 105 00000100:00100000:3.0:1789438405.027998:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de569208-d9a5-4940-b85b-d390a73b7b00+12:13758:x1876361749838080:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789438405.028248:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de569208-d9a5-4940-b85b-d390a73b7b00+12:13758:x1876361749838080:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 Request processed in 251us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438405.028256:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 105 00000100:00100000:1.0:1789438405.033753:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438405.033867:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749838208 00000100:00100000:3.0:1789438405.033876:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749838208 00000100:00100000:3.0:1789438405.033940:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 106 00000100:00100000:3.0:1789438405.033950:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de569208-d9a5-4940-b85b-d390a73b7b00+12:13758:x1876361749838208:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789438405.034157:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de569208-d9a5-4940-b85b-d390a73b7b00+12:13758:x1876361749838208:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 Request processed in 207us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438405.034165:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 106 00000100:00100000:0.0:1789438405.046015:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438405.048306:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749838336 00000100:00100000:1.0:1789438405.048321:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749838336 00000100:00100000:1.0:1789438405.048376:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 107 00000100:00100000:1.0:1789438405.048386:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de569208-d9a5-4940-b85b-d390a73b7b00+12:13758:x1876361749838336:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789438405.048403:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438405.048420:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991e0714200/0x7a8dd0fcbb926101 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x483b483084eaa627 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438405.048446:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991e0714200/0x7a8dd0fcbb926101 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa627 expref: 13 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438405.048470:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991e0714200/0x7a8dd0fcbb926101 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa627 expref: 13 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438405.048480:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e0714200, rc 0) 00000100:00100000:1.0:1789438405.048535:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de569208-d9a5-4940-b85b-d390a73b7b00+13:13758:x1876361749838336:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 Request processed in 152us (2530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438405.048542:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 107 00000100:00100000:1.0:1789438405.055247:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438405.055336:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749838464 00000100:00100000:3.0:1789438405.055345:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749838464 00000100:00100000:3.0:1789438405.055397:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 108 00000100:00100000:3.0:1789438405.055408:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de569208-d9a5-4940-b85b-d390a73b7b00+13:13758:x1876361749838464:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789438405.055677:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de569208-d9a5-4940-b85b-d390a73b7b00+13:13758:x1876361749838464:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 Request processed in 271us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438405.055684:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 108 00000100:00100000:1.0:1789438405.069384:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438405.069506:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749838592 00000100:00100000:3.0:1789438405.069516:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749838592 00000100:00100000:3.0:1789438405.069571:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 109 00000100:00100000:3.0:1789438405.069590:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de569208-d9a5-4940-b85b-d390a73b7b00+13:13758:x1876361749838592:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789438405.069824:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de569208-d9a5-4940-b85b-d390a73b7b00+13:13758:x1876361749838592:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 Request processed in 243us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438405.069832:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 109 10000000:01000000:0.0:1789438405.559079:0:14399:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789438405.559086:0:14399:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9990c187d000 from 10 10000000:01000000:0.0:1789438405.559091:0:14399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789438405.559135:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991f3d63400/0x7a8dd0fcbb926108 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438405.559147:0:14399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991f3d63400/0x7a8dd0fcbb926108 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438405.559157:0:14399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991f3d63400/0x7a8dd0fcbb926108 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438405.559179:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769751936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789438405.559236:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438405.559299:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff9990c1385180 going to sleep for 11 seconds 00000100:00100000:3.0:1789438405.559413:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769751936 00000100:00100000:3.0:1789438405.559421:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769751936 00000100:00100000:3.0:1789438405.559489:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789438405.559499:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+16:14399:x1876361769751936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789438405.559511:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438405.559524:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb92610f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb926108 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438405.559563:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb92610f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb926108 expref: 17 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438405.559573:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c2a54400/0x7a8dd0fcbb92610f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb926108 expref: 17 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438405.559593:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a54400, rc 0) 00000100:00100000:3.0:1789438405.559646:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+17:14399:x1876361769751936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438405.559652:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789438405.559699:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769751936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789438405.559868:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991f3d63400/0x7a8dd0fcbb926108 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb92610f expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438405.559878:0:14399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991f3d63400/0x7a8dd0fcbb926108 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb92610f expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438405.559934:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa644e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769752064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789438405.559960:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438405.559981:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e1f4e240 going to sleep for 11 seconds 00000100:00100000:3.0:1789438405.560005:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769752064 00000100:00100000:3.0:1789438405.560009:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769752064 00000100:00100000:3.0:1789438405.560029:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789438405.560036:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+17:14399:x1876361769752064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789438405.560253:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+17:14399:x1876361769752064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 216us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438405.560269:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789438405.560321:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa644e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769752064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789438405.560347:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa644e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769752192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789438405.560383:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438405.560397:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e1f4e240 going to sleep for 11 seconds 00000100:00100000:3.0:1789438405.560409:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769752192 00000100:00100000:3.0:1789438405.560412:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769752192 00000100:00100000:3.0:1789438405.560433:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789438405.560439:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+17:14399:x1876361769752192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789438405.560582:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+17:14399:x1876361769752192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438405.560588:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789438405.560625:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa644e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769752192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789438405.561255:0:16587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789438405.561306:0:14399:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789438405.561323:0:14399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789438405.561331:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991f3d63400/0x7a8dd0fcbb926108 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb92610f expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438405.561340:0:14399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991f3d63400/0x7a8dd0fcbb926108 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb92610f expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789438405.561349:0:14399:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789438405.561352:0:14399:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9991e0122000 from 10 10000000:01000000:3.0:1789438405.561354:0:14399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789438405.561377:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c2a54c00/0x7a8dd0fcbb926116 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438405.561392:0:14399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991c2a54c00/0x7a8dd0fcbb926116 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438405.561402:0:14399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991c2a54c00/0x7a8dd0fcbb926116 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438405.561418:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa644e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769752320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789438405.561468:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438405.561493:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e1f4e840 going to sleep for 11 seconds 00000100:00100000:3.0:1789438405.561508:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769752320 00000100:00100000:3.0:1789438405.561513:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769752320 00000100:00100000:3.0:1789438405.561541:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789438405.561547:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa2d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+17:14399:x1876361769752320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789438405.561556:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438405.561567:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c2a54000/0x7a8dd0fcbb92611d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb926116 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438405.561586:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c2a54000/0x7a8dd0fcbb92611d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb926116 expref: 18 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438405.561596:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c2a54000/0x7a8dd0fcbb92611d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb926116 expref: 18 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438405.561604:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a54000, rc 0) 00000100:00100000:3.0:1789438405.561633:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa2d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+18:14399:x1876361769752320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438405.561639:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789438405.561680:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa644e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769752320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789438405.561692:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991c2a54c00/0x7a8dd0fcbb926116 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb92611d expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438405.561701:0:14399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991c2a54c00/0x7a8dd0fcbb926116 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb92611d expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438405.561770:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa644e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769752448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789438405.561793:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438405.561810:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e1f4e840 going to sleep for 11 seconds 00000100:00100000:3.0:1789438405.561820:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769752448 00000100:00100000:3.0:1789438405.561823:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769752448 00000100:00100000:3.0:1789438405.561841:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789438405.561847:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+18:14399:x1876361769752448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789438405.562041:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+18:14399:x1876361769752448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438405.562048:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789438405.562077:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa644e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769752448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789438405.562101:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991fa644e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769752576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789438405.562136:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789438405.562148:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e1f4e840 going to sleep for 11 seconds 00000100:00100000:3.0:1789438405.562158:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769752576 00000100:00100000:3.0:1789438405.562161:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769752576 00000100:00100000:3.0:1789438405.562180:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789438405.562186:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+18:14399:x1876361769752576:12345-0@lo:503:ll_cfg_requeue.0 00010000:00010000:2.0:1789438405.566533:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789438405.567119:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+18:14399:x1876361769752576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4928us (4978us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438405.567146:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789438405.570504:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991fa644e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769752576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789438405.575245:0:16588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789438405.578758:0:14399:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789438405.578795:0:14399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789438405.578807:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991c2a54c00/0x7a8dd0fcbb926116 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb92611d expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438405.578820:0:14399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991c2a54c00/0x7a8dd0fcbb926116 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb92611d expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789438405.578846:0:14399:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789438405.578849:0:14399:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9991ff9b0800 from 10 10000000:01000000:0.0:1789438405.578851:0:14399:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789438405.578887:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991f3d63600/0x7a8dd0fcbb926124 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438405.578896:0:14399:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9991f3d63600/0x7a8dd0fcbb926124 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438405.578906:0:14399:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9991f3d63600/0x7a8dd0fcbb926124 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438405.578930:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769752704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789438405.578992:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438405.579035:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff9990c1385180 going to sleep for 11 seconds 00000100:00100000:3.0:1789438405.579124:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769752704 00000100:00100000:3.0:1789438405.579132:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769752704 00000100:00100000:3.0:1789438405.579175:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789438405.579184:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+18:14399:x1876361769752704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789438405.579197:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789438405.579210:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9991c2a55800/0x7a8dd0fcbb92612b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a8dd0fcbb926124 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438405.579232:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9991c2a55800/0x7a8dd0fcbb92612b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7a8dd0fcbb926124 expref: 19 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438405.579242:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9991c2a55800/0x7a8dd0fcbb92612b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7a8dd0fcbb926124 expref: 19 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438405.579251:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c2a55800, rc 0) 00000100:00100000:3.0:1789438405.579311:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3666e65-cb7a-452a-a637-b1a251df2a46+19:14399:x1876361769752704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438405.579317:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789438405.579534:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769752704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789438405.579550:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9991f3d63600/0x7a8dd0fcbb926124 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb92612b expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438405.579559:0:14399:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9991f3d63600/0x7a8dd0fcbb926124 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7a8dd0fcbb92612b expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438405.579614:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769752832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789438405.579640:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438405.579667:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d073c480 going to sleep for 11 seconds 00000100:00100000:0.0:1789438405.579808:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769752832 00000100:00100000:0.0:1789438405.579813:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769752832 00000100:00100000:0.0:1789438405.579848:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789438405.579856:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+19:14399:x1876361769752832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789438405.580075:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+19:14399:x1876361769752832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 220us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438405.580082:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789438405.580163:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769752832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789438405.580191:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769752960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789438405.580226:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438405.580252:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991d073c480 going to sleep for 11 seconds 00000100:00100000:3.0:1789438405.580393:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769752960 00000100:00100000:3.0:1789438405.580398:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769752960 00000100:00100000:3.0:1789438405.580418:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789438405.580425:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+19:14399:x1876361769752960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789438405.580588:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3666e65-cb7a-452a-a637-b1a251df2a46+19:14399:x1876361769752960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438405.580595:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789438405.580642:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b3666e65-cb7a-452a-a637-b1a251df2a46:14399:1876361769752960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789438405.581258:0:16589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789438405.581319:0:14399:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789438405.581338:0:14399:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789438405.581345:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9991f3d63600/0x7a8dd0fcbb926124 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb92612b expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438405.581354:0:14399:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9991f3d63600/0x7a8dd0fcbb926124 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7a8dd0fcbb92612b expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438406.582995:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789438406.967645:0:14433:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789438407.131788:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438407.131842:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438407.131875:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438407.131904:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438407.131921:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438407.131935:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438407.131953:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438407.132049:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749838976 00000100:00100000:1.0:1789438407.132059:0:15085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749838976 00000100:00100000:1.0:1789438407.132109:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749839488 00000100:00100000:1.0:1789438407.132112:0:15085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749839488 00000100:00100000:1.0:1789438407.132122:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749839104 00000100:00100000:1.0:1789438407.132125:0:15085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749839104 00000100:00100000:1.0:1789438407.132135:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749839360 00000100:00100000:1.0:1789438407.132137:0:15085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749839360 00000100:00100000:1.0:1789438407.132150:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:1.0:1789438407.132158:0:15085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+5:2353:x1876361749838976:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438407.132219:0:15085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+5:2353:x1876361749838976:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 61us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438407.132226:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:1.0:1789438407.132241:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 14 00000100:00100000:1.0:1789438407.132247:0:15085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfb3eacc-1e1b-434b-806a-250616f742cf+5:2353:x1876361749839488:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438407.132268:0:15085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfb3eacc-1e1b-434b-806a-250616f742cf+5:2353:x1876361749839488:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 22us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438407.132289:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 14 00000100:00100000:1.0:1789438407.132300:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:1.0:1789438407.132326:0:15085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+5:2353:x1876361749839104:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438407.132349:0:15085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+5:2353:x1876361749839104:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 24us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438407.132355:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:1.0:1789438407.132365:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:1.0:1789438407.132371:0:15085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa644000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfb3eacc-1e1b-434b-806a-250616f742cf+5:2353:x1876361749839360:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438407.132395:0:15085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa644000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfb3eacc-1e1b-434b-806a-250616f742cf+5:2353:x1876361749839360:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 24us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438407.132401:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:1.0:1789438407.132419:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749839232 00000100:00100000:1.0:1789438407.132422:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749839232 00000100:00100000:1.0:1789438407.132443:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749838848 00000100:00100000:1.0:1789438407.132457:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749838848 00000100:00100000:1.0:1789438407.132472:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 23 00000100:00100000:1.0:1789438407.132478:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfb3eacc-1e1b-434b-806a-250616f742cf+6:2353:x1876361749839232:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438407.132502:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfb3eacc-1e1b-434b-806a-250616f742cf+6:2353:x1876361749839232:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 23us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438407.132508:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 23 00000100:00100000:1.0:1789438407.132518:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 24 00000100:00100000:1.0:1789438407.132524:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+6:2353:x1876361749838848:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789438407.132541:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+6:2353:x1876361749838848:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 17us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438407.132553:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 24 00000100:00100000:0.0:1789438407.132742:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749838720 00000100:00100000:0.0:1789438407.132746:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749838720 00000100:00100000:0.0:1789438407.132779:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 119 00000100:00100000:0.0:1789438407.132786:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de569208-d9a5-4940-b85b-d390a73b7b00+13:2353:x1876361749838720:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789438407.132819:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de569208-d9a5-4940-b85b-d390a73b7b00+13:2353:x1876361749838720:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 34us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438407.132832:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 119 00000100:00080000:3.0:1789438407.132972:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789438407.132976:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789438407.132978:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789438407.425819:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438407.426055:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749839616 00000100:00100000:1.0:1789438407.426065:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749839616 00000100:00100000:1.0:1789438407.426160:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:1.0:1789438407.426170:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+6:14416:x1876361749839616:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789438407.426190:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438407.426208:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb926132 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa62e expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.426268:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714a00/0x7a8dd0fcbb926139 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.426282:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714a00/0x7a8dd0fcbb926139 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.426294:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714a00/0x7a8dd0fcbb926139 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.426319:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926140 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.426335:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.426343:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.426643:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715c00/0x7a8dd0fcbb926147 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.426664:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715c00/0x7a8dd0fcbb926147 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.426672:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715c00/0x7a8dd0fcbb926147 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438407.426695:0:14402:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789438407.426699:0:14402:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789438407.426766:0:14402:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715c00/0x7a8dd0fcbb926147 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.426778:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714a00/0x7a8dd0fcbb926139 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.426784:0:14402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714a00/0x7a8dd0fcbb926139 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.426790:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714a00/0x7a8dd0fcbb926139 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.426795:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0714a00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438407.426799:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714a00/0x7a8dd0fcbb926139 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.426806:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714a00/0x7a8dd0fcbb926139 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.426817:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991c3e2d200) 00010000:00010000:1.0:1789438407.426820:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438407.426825:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714a00/0x7a8dd0fcbb926139 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.426857:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714a00/0x7a8dd0fcbb926139 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.426870:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.426876:0:14402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926140 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.426882:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926140 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.426888:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0715000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438407.426891:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926140 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.426897:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926140 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.426904:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9991c3e2d900) 00010000:00010000:1.0:1789438407.426907:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438407.426910:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926140 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.426916:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926140 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.426947:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb926132 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa62e expref: 8 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.427052:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715c00/0x7a8dd0fcbb926147 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa62e expref: 7 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.427060:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9991c3e2d600) 00010000:00010000:1.0:1789438407.427062:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789438407.427065:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e0715c00, rc 0) 00000100:00100000:1.0:1789438407.427142:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+7:14416:x1876361749839616:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 973us (1331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438407.427150:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:0.0:1789438407.441633:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438407.445440:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749839872 00000100:00100000:2.0:1789438407.445467:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749839872 00000100:00100000:2.0:1789438407.445542:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:2.0:1789438407.445553:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+7:14416:x1876361749839872:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789438407.445587:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438407.445607:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb92614e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa635 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.445673:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1c00/0x7a8dd0fcbb926155 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.445688:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1c00/0x7a8dd0fcbb926155 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.445700:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1c00/0x7a8dd0fcbb926155 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.445769:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1800/0x7a8dd0fcbb92615c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.445777:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1800/0x7a8dd0fcbb92615c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.445784:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1800/0x7a8dd0fcbb92615c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.446077:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0600/0x7a8dd0fcbb926163 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.446086:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0600/0x7a8dd0fcbb926163 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.446093:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0600/0x7a8dd0fcbb926163 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438407.446102:0:14401:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789438407.446278:0:14401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1c00/0x7a8dd0fcbb926155 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.446285:0:14401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1c00/0x7a8dd0fcbb926155 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.446291:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1c00/0x7a8dd0fcbb926155 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.446298:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c69e1c00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438407.446301:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1c00/0x7a8dd0fcbb926155 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.446308:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1c00/0x7a8dd0fcbb926155 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.446319:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9991c3e2d600) 00010000:00010000:2.0:1789438407.446322:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438407.446326:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1c00/0x7a8dd0fcbb926155 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.446331:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1c00/0x7a8dd0fcbb926155 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.446341:0:14401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1800/0x7a8dd0fcbb92615c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.446347:0:14401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1800/0x7a8dd0fcbb92615c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.446352:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1800/0x7a8dd0fcbb92615c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.446367:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c69e1800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438407.446370:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1800/0x7a8dd0fcbb92615c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.446376:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1800/0x7a8dd0fcbb92615c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.446384:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9991d5872700) 00010000:00010000:2.0:1789438407.446386:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438407.446389:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1800/0x7a8dd0fcbb92615c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.446395:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1800/0x7a8dd0fcbb92615c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.446872:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb92614e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa635 expref: 10 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.446888:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0600/0x7a8dd0fcbb926163 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa635 expref: 9 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.446896:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9991d5872000) 00010000:00010000:2.0:1789438407.446899:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438407.446901:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c69e0600, rc 0) 00000100:00100000:2.0:1789438407.446974:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+9:14416:x1876361749839872:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 1422us (5350us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789438407.446983:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:3.0:1789438407.468935:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438407.469541:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749840000 00000100:00100000:1.0:1789438407.469556:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749840000 00000100:00100000:1.0:1789438407.469629:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 17 00000100:00100000:1.0:1789438407.469640:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+9:14416:x1876361749840000:12345-192.168.206.9@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789438407.469790:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+9:14416:x1876361749840000:12345-192.168.206.9@tcp:59:lhsmtool_posix.0 Request processed in 152us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438407.469797:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 17 00000100:00100000:0.0:1789438407.510658:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438407.525422:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749840128 00000100:00100000:1.0:1789438407.525455:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749840128 00000100:00100000:1.0:1789438407.525561:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 18 00000100:00100000:1.0:1789438407.525574:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+9:14422:x1876361749840128:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438407.525603:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438407.525630:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb926171 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa63c expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.525729:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926178 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.525780:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926178 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.525794:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926178 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.525813:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714a00/0x7a8dd0fcbb92617f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.525821:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714a00/0x7a8dd0fcbb92617f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.525829:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714a00/0x7a8dd0fcbb92617f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.526084:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926178 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.526093:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926178 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.526457:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926178 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.526466:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0715000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438407.526471:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926178 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.526479:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926178 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.526495:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991c3e2d200) 00010000:00010000:1.0:1789438407.526504:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438407.526512:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926178 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.526519:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926178 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.526535:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714a00/0x7a8dd0fcbb92617f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.526541:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714a00/0x7a8dd0fcbb92617f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.526548:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714a00/0x7a8dd0fcbb92617f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.526553:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0714a00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438407.526556:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714a00/0x7a8dd0fcbb92617f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.526562:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714a00/0x7a8dd0fcbb92617f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.526569:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9991c3e2d900) 00010000:00010000:1.0:1789438407.526572:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438407.526575:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714a00/0x7a8dd0fcbb92617f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.526581:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714a00/0x7a8dd0fcbb92617f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.526626:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb926171 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa63c expref: 10 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.526645:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991c3e2d200) 00010000:00010000:1.0:1789438407.526647:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438407.526651:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb926171 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa63c expref: 10 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.526662:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e0714800, rc 0) 00000100:00100000:1.0:1789438407.526925:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+9:14422:x1876361749840128:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 1352us (16279us total) trans 0 rc 301/301 00000100:00100000:1.0:1789438407.526935:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 18 00000100:00100000:0.0:1789438407.545385:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438407.545546:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749840256 00000100:00100000:2.0:1789438407.545575:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749840256 00000100:00100000:2.0:1789438407.545646:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00100000:2.0:1789438407.545659:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+9:14422:x1876361749840256:12345-192.168.206.9@tcp:700:lfs.0 00000100:00100000:2.0:1789438407.545836:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+9:14422:x1876361749840256:12345-192.168.206.9@tcp:700:lfs.0 Request processed in 179us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438407.545845:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00100000:0.0:1789438407.550787:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438407.550974:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749840512 00000100:00100000:2.0:1789438407.550988:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749840512 00000100:00100000:2.0:1789438407.551054:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 19 00000100:00100000:2.0:1789438407.551066:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+9:14422:x1876361749840512:12345-192.168.206.9@tcp:36:lfs.0 00010000:00010000:2.0:1789438407.551151:0:14401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438407.551183:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb9260b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa5b7 expref: 9 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.551206:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991c3e2d200) 00010000:00010000:2.0:1789438407.551212:0:14401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789438407.551533:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb926186 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.551553:0:14401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb9260ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa619 expref: 5 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.551566:0:14401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb926186 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.551611:0:14401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb9260ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa619 expref: 5 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.551642:0:14401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb9260ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa619 expref: 5 pid: 14402 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438407.551660:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991facb4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14401:1876361769753088:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789438407.552245:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e75503c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789438407.574800:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991facb4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14401:1876361769753088:192.168.206.9@tcp:104: 00000100:00100000:1.0:1789438407.574833:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00010000:00010000:2.0:1789438407.574843:0:14401:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb926186 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438407.575923:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749840640 00000100:00100000:3.0:1789438407.575937:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749840640 00010000:00010000:3.0:1789438407.575988:0:14388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb9260ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa619 expref: 6 pid: 14402 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438407.576042:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:3.0:1789438407.576053:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfb3eacc-1e1b-434b-806a-250616f742cf+6:2353:x1876361749840640:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789438407.576089:0:14388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789438407.576110:0:14388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb9260ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa619 expref: 6 pid: 14402 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438407.576125:0:14388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb9260ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa619 expref: 6 pid: 14402 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438407.576154:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb9260ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa619 expref: 6 pid: 14402 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438407.576174:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991c3e2d200) 00010000:00010000:3.0:1789438407.576180:0:14388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb926186 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438407.576191:0:14388:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb926186 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438407.576199:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb926186 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438407.576239:0:14388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789438407.576422:0:14401:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb926186 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.576431:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb926186 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.576470:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb92618d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.576483:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb92618d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.576491:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb92618d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438407.583554:0:14401:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789438407.583581:0:14401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb926186 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.583605:0:14401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb926186 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.583614:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb926186 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.583621:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c69e1400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438407.583627:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb926186 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.583636:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb926186 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.583657:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991c3e2d200) 00010000:00010000:1.0:1789438407.583661:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438407.583667:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb926186 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.583673:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb926186 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789438407.583701:0:14401:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003dfbabac reply state 000000007702d037 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb92618d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438407.583771:0:14401:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789438407.583979:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfb3eacc-1e1b-434b-806a-250616f742cf+5:2353:x1876361749840640:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 7919us (9138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438407.583992:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:1.0:1789438407.588553:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+10:14422:x1876361749840512:12345-192.168.206.9@tcp:36:lfs.0 Request processed in 37470us (37772us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789438407.588569:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 19 00010000:00010000:1.0:1789438407.598422:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb92618d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.598477:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb92618d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.598486:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb92618d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.598492:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0714800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438407.598498:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb92618d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.598507:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb92618d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.598528:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9991c3e2d900) 00010000:00010000:1.0:1789438407.598532:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438407.598538:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb92618d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.598544:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb92618d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.607505:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438407.695277:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438407.695392:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749840768 00000100:00100000:2.0:1789438407.695403:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749840768 00000100:00100000:2.0:1789438407.695474:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 20 00000100:00100000:2.0:1789438407.695485:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+9:14430:x1876361749840768:12345-192.168.206.9@tcp:101:lctl.0 00010000:00010000:2.0:1789438407.695514:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438407.695536:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1200/0x7a8dd0fcbb926194 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa643 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.695611:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1e00/0x7a8dd0fcbb92619b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.695625:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1e00/0x7a8dd0fcbb92619b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.695636:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1e00/0x7a8dd0fcbb92619b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438407.695689:0:14403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789438407.695693:0:14403:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789438407.695771:0:14403:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1e00/0x7a8dd0fcbb92619b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.695794:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1200/0x7a8dd0fcbb926194 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa643 expref: 11 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.695810:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1e00/0x7a8dd0fcbb92619b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa643 expref: 10 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.695818:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872700) 00010000:00010000:2.0:1789438407.695821:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789438407.695825:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c69e1e00, rc 0) 00000100:00100000:2.0:1789438407.695890:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+10:14430:x1876361749840768:12345-192.168.206.9@tcp:101:lctl.0 Request processed in 407us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438407.695898:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 20 00000100:00100000:0.0:1789438407.733504:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438407.733607:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749840896 00000100:00100000:1.0:1789438407.733618:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749840896 00000100:00100000:1.0:1789438407.733677:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 21 00000100:00100000:1.0:1789438407.733687:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfb3eacc-1e1b-434b-806a-250616f742cf+5:14431:x1876361749840896:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438407.733730:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438407.733749:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb9261a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa64a expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.733834:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714a00/0x7a8dd0fcbb9261a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.733850:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714a00/0x7a8dd0fcbb9261a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.733861:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714a00/0x7a8dd0fcbb9261a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438407.733896:0:14401:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789438407.733899:0:14401:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789438407.733917:0:14401:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714a00/0x7a8dd0fcbb9261a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.733939:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb9261a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa64a expref: 7 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.733956:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714a00/0x7a8dd0fcbb9261a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa64a expref: 6 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.733965:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872700) 00010000:00010000:1.0:1789438407.733968:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789438407.733972:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e0714a00, rc 0) 00000100:00100000:1.0:1789438407.734046:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfb3eacc-1e1b-434b-806a-250616f742cf+6:14431:x1876361749840896:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 361us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438407.734054:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 21 00000100:00100000:0.0:1789438407.736332:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438407.736416:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749841024 00000100:00100000:1.0:1789438407.736425:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749841024 00000100:00100000:1.0:1789438407.736501:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 22 00000100:00100000:1.0:1789438407.736516:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfb3eacc-1e1b-434b-806a-250616f742cf+6:14431:x1876361749841024:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438407.736533:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438407.736551:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb9261b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa651 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.736620:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb9261b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.736634:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb9261b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.736647:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb9261b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.736662:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb9261be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.736669:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb9261be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.736675:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb9261be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.736832:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715600/0x7a8dd0fcbb9261c5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.736846:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715600/0x7a8dd0fcbb9261c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.736854:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715600/0x7a8dd0fcbb9261c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438407.736898:0:14402:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789438407.736901:0:14402:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789438407.736918:0:14402:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715600/0x7a8dd0fcbb9261c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.736931:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb9261b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.736937:0:14402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb9261b7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.736943:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb9261b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.736949:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0715800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438407.736953:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb9261b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.736960:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb9261b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.736972:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872700) 00010000:00010000:1.0:1789438407.736975:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438407.736979:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb9261b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.736985:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb9261b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.736996:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb9261be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.737012:0:14402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb9261be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.737018:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb9261be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.737023:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0715200 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438407.737026:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb9261be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.737033:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb9261be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.737040:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9991c3e2d900) 00010000:00010000:1.0:1789438407.737043:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438407.737046:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb9261be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.737051:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb9261be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.737083:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb9261b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa651 expref: 8 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.737096:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715600/0x7a8dd0fcbb9261c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa651 expref: 7 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.737103:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9991c3e2d200) 00010000:00010000:1.0:1789438407.737105:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789438407.737114:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e0715600, rc 0) 00000100:00100000:1.0:1789438407.737181:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfb3eacc-1e1b-434b-806a-250616f742cf+7:14431:x1876361749841024:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 668us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438407.737188:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 22 00000100:00100000:3.0:1789438407.742061:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438407.742152:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749841280 00000100:00100000:2.0:1789438407.742162:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749841280 00000100:00100000:2.0:1789438407.742212:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 23 00000100:00100000:2.0:1789438407.742222:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991fa644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfb3eacc-1e1b-434b-806a-250616f742cf+7:14431:x1876361749841280:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789438407.742242:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438407.742260:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1200/0x7a8dd0fcbb9261cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa658 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438407.742342:0:14403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789438407.742490:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1200/0x7a8dd0fcbb9261cc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa658 expref: 9 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.742515:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872700) 00010000:00010000:2.0:1789438407.742518:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789438407.742524:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1200/0x7a8dd0fcbb9261cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa658 expref: 9 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.742538:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c69e1200, rc 0) 00000100:00100000:2.0:1789438407.742663:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991fa644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfb3eacc-1e1b-434b-806a-250616f742cf+8:14431:x1876361749841280:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 442us (611us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1789438407.742670:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 23 00000100:00100000:0.0:1789438407.747453:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438407.747516:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749841536 00000100:00100000:2.0:1789438407.747526:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749841536 00000100:00100000:2.0:1789438407.747588:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 24 00000100:00100000:2.0:1789438407.747597:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfb3eacc-1e1b-434b-806a-250616f742cf+8:14431:x1876361749841536:12345-192.168.206.9@tcp:36:lfs.0 00010000:00010000:2.0:1789438407.747643:0:14401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438407.747666:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715600/0x7a8dd0fcbb9261c5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa651 expref: 8 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.747684:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9991c3e2d200) 00010000:00010000:2.0:1789438407.747693:0:14401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789438407.747745:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb9261da lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.747758:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb9261da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.747768:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb9261da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789438407.747971:0:14401:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000094d42dae reply state 00000000488cd0db transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb9261da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438407.747981:0:14401:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789438407.747988:0:14401:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789438407.748058:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfb3eacc-1e1b-434b-806a-250616f742cf+9:14431:x1876361749841536:12345-192.168.206.9@tcp:36:lfs.0 Request processed in 462us (623us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789438407.748065:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 24 00010000:00010000:3.0:1789438407.750878:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb9261da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438407.750893:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb9261da lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438407.750910:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb9261da lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438407.750915:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c69e0800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438407.750921:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb9261da lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438407.750929:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb9261da lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438407.750944:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9991d5872a00) 00010000:00010000:3.0:1789438407.750946:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1789438407.750951:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb9261da lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438407.750956:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb9261da lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438407.753704:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438407.753875:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749841792 00000100:00100000:1.0:1789438407.753885:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749841792 00000100:00100000:1.0:1789438407.753934:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 2 00000100:00100000:1.0:1789438407.753945:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfb3eacc-1e1b-434b-806a-250616f742cf+8:14431:x1876361749841792:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:1.0:1789438407.754173:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfb3eacc-1e1b-434b-806a-250616f742cf+9:14431:x1876361749841792:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 228us (477us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789438407.754181:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 2 00000100:00100000:2.0:1789438407.759539:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438407.759640:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749842048 00000100:00100000:1.0:1789438407.759650:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749842048 00000100:00100000:1.0:1789438407.759783:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 25 00000100:00100000:1.0:1789438407.759793:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfb3eacc-1e1b-434b-806a-250616f742cf+9:14431:x1876361749842048:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438407.759816:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438407.759836:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb9261e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa65f expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.759913:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb9261e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.759927:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb9261e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.759937:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb9261e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.759950:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb9261ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.759969:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb9261ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.759975:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb9261ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438407.760074:0:14402:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789438407.760157:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb9261e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.760165:0:14402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb9261e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.760172:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb9261e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.760178:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0715200 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438407.760182:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb9261e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.760188:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb9261e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.760200:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872700) 00010000:00010000:1.0:1789438407.760203:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438407.760208:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb9261e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.760214:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb9261e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.760237:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb9261ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.760243:0:14402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb9261ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.760249:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb9261ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.760254:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0715800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438407.760257:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb9261ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.760263:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb9261ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.760271:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9991c3e2d900) 00010000:00010000:1.0:1789438407.760273:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438407.760276:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb9261ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.760282:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb9261ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.760319:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb9261e1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa65f expref: 11 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.760329:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872700) 00010000:00010000:1.0:1789438407.760332:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789438407.760342:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb9261e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa65f expref: 11 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.760352:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e0715000, rc 0) 00000100:00100000:1.0:1789438407.760402:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfb3eacc-1e1b-434b-806a-250616f742cf+10:14431:x1876361749842048:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 611us (871us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1789438407.760409:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 25 00000100:00100000:3.0:1789438407.763644:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438407.763739:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749842176 00000100:00100000:1.0:1789438407.763749:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749842176 00000100:00100000:1.0:1789438407.763805:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 26 00000100:00100000:1.0:1789438407.763815:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfb3eacc-1e1b-434b-806a-250616f742cf+10:14431:x1876361749842176:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438407.763837:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438407.763858:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb9261fd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa666 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.763967:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714400/0x7a8dd0fcbb926204 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.763979:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714400/0x7a8dd0fcbb926204 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.763989:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714400/0x7a8dd0fcbb926204 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438407.764010:0:14403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789438407.764014:0:14403:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789438407.764030:0:14403:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714400/0x7a8dd0fcbb926204 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.764054:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb9261fd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa666 expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.764078:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714400/0x7a8dd0fcbb926204 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa666 expref: 11 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.764086:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9991c3e2d500) 00010000:00010000:1.0:1789438407.764089:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789438407.764092:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e0714400, rc 0) 00000100:00100000:1.0:1789438407.764141:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfb3eacc-1e1b-434b-806a-250616f742cf+11:14431:x1876361749842176:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 327us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438407.764148:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 26 00000100:00100000:0.0:1789438407.767552:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438407.767631:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749842304 00000100:00100000:1.0:1789438407.767641:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749842304 00000100:00100000:1.0:1789438407.767695:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 3 00000100:00100000:1.0:1789438407.767735:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfb3eacc-1e1b-434b-806a-250616f742cf+11:14431:x1876361749842304:12345-192.168.206.9@tcp:37:lfs.0 00000100:00100000:0.0:1789438407.785567:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfb3eacc-1e1b-434b-806a-250616f742cf+11:14431:x1876361749842304:12345-192.168.206.9@tcp:37:lfs.0 Request processed in 17853us (18013us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438407.785588:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 3 00000100:00100000:3.0:1789438407.792150:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438407.792439:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749842560 00000100:00100000:2.0:1789438407.792459:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749842560 00000100:00100000:2.0:1789438407.792561:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:2.0:1789438407.792583:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c8106050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfb3eacc-1e1b-434b-806a-250616f742cf+11:14431:x1876361749842560:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:2.0:1789438407.792839:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c8106050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfb3eacc-1e1b-434b-806a-250616f742cf+12:14431:x1876361749842560:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 258us (701us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789438407.792855:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:3.0:1789438407.886826:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438407.887162:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749842688 00000100:00100000:1.0:1789438407.887171:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749842688 00000100:00100000:1.0:1789438407.887237:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 27 00000100:00100000:1.0:1789438407.887247:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+10:14437:x1876361749842688:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:1.0:1789438407.887268:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438407.887287:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb92620b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa66d expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.887348:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926212 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.887362:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926212 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.887403:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926212 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.887423:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb926219 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.887430:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb926219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.887435:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb926219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.887533:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb926220 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.887542:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb926220 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.887549:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb926220 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438407.887575:0:14402:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789438407.887578:0:14402:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789438407.887628:0:14402:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb926220 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.887640:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926212 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.887646:0:14402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926212 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.887660:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926212 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.887666:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0715000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438407.887671:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926212 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.887679:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926212 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.887690:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872700) 00010000:00010000:1.0:1789438407.887693:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438407.887698:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926212 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.887704:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926212 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.887748:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb926219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.887755:0:14402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb926219 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.887760:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb926219 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.887765:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0715800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438407.887768:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb926219 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.887784:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb926219 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.887792:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9991c3e2d900) 00010000:00010000:1.0:1789438407.887795:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438407.887798:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb926219 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.887804:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb926219 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.887853:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb92620b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa66d expref: 12 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.887870:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715200/0x7a8dd0fcbb926220 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa66d expref: 11 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.887877:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9991c3e2d500) 00010000:00010000:1.0:1789438407.887879:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789438407.887881:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e0715200, rc 0) 00000100:00100000:1.0:1789438407.887947:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+11:14437:x1876361749842688:12345-192.168.206.9@tcp:101:bash.0 Request processed in 701us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438407.887954:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 27 00000100:00100000:0.0:1789438407.894797:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438407.895979:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749842944 00000100:00100000:2.0:1789438407.895992:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749842944 00000100:00100000:2.0:1789438407.896145:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 28 00000100:00100000:2.0:1789438407.896156:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff93b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+11:14437:x1876361749842944:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:2.0:1789438407.896177:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438407.896198:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1200/0x7a8dd0fcbb926227 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa674 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.896307:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb92622e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.896352:0:14401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714400/0x7a8dd0fcbb926204 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa666 expref: 11 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.896361:0:14401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb92622e lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.896525:0:14401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714400/0x7a8dd0fcbb926204 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa666 expref: 11 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.896539:0:14401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714400/0x7a8dd0fcbb926204 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa666 expref: 11 pid: 14403 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438407.896553:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991facb4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14401:1876361769753216:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789438407.896808:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f44a7480 going to sleep for 11 seconds 00000100:00100000:3.0:1789438407.907644:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438407.907740:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749843072 00000100:00100000:0.0:1789438407.907749:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749843072 00010000:00010000:0.0:1789438407.907798:0:14389:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714400/0x7a8dd0fcbb926204 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa666 expref: 12 pid: 14403 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438407.907836:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:0.0:1789438407.907854:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfb3eacc-1e1b-434b-806a-250616f742cf+12:2354:x1876361749843072:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789438407.907868:0:14389:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438407.907875:0:14389:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714400/0x7a8dd0fcbb926204 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa666 expref: 12 pid: 14403 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438407.907887:0:14389:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714400/0x7a8dd0fcbb926204 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa666 expref: 12 pid: 14403 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438407.907921:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9991c3e2d500) 00010000:00010000:0.0:1789438407.907925:0:14389:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb92622e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438407.907935:0:14389:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb92622e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438407.907943:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb92622e lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438407.907962:0:14389:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789438407.908063:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714400/0x7a8dd0fcbb926204 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa666 expref: 12 pid: 14403 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438407.908080:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991facb4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14401:1876361769753216:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789438407.908099:0:14401:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb92622e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.908108:0:14401:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb92622e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.908114:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb92622e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.908135:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1c00/0x7a8dd0fcbb926235 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.908150:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1c00/0x7a8dd0fcbb926235 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.908156:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1c00/0x7a8dd0fcbb926235 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.908946:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1800/0x7a8dd0fcbb92623c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.908958:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1800/0x7a8dd0fcbb92623c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.908965:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1800/0x7a8dd0fcbb92623c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438407.908975:0:14401:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789438407.909000:0:14401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb92622e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.909007:0:14401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb92622e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.910533:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb92622e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.910543:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c69e0800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438407.910547:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb92622e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.910669:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb92622e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.913468:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9991c3e2d500) 00010000:00010000:2.0:1789438407.913472:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789438407.913479:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb92622e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.913486:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb92622e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789438407.913506:0:14401:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000825f42cf reply state 0000000022b7064f transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1c00/0x7a8dd0fcbb926235 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438407.913515:0:14401:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789438407.913569:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1200/0x7a8dd0fcbb926227 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa674 expref: 14 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.913585:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1800/0x7a8dd0fcbb92623c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa674 expref: 13 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438407.913592:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9991d5872800) 00010000:00010000:2.0:1789438407.913594:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789438407.913597:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c69e1800, rc 0) 00000100:00100000:0.0:1789438407.917268:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfb3eacc-1e1b-434b-806a-250616f742cf+11:2354:x1876361749843072:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 9412us (9620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438407.917281:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:2.0:1789438407.918528:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff93b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+14:14437:x1876361749842944:12345-192.168.206.9@tcp:101:bash.0 Request processed in 22366us (23732us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789438407.918539:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 28 00010000:00010000:1.0:1789438407.930075:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1c00/0x7a8dd0fcbb926235 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.930093:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1c00/0x7a8dd0fcbb926235 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.930122:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1c00/0x7a8dd0fcbb926235 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.930129:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c69e1c00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438407.930134:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1c00/0x7a8dd0fcbb926235 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.930142:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1c00/0x7a8dd0fcbb926235 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.930158:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9991d5872100) 00010000:00010000:1.0:1789438407.930161:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789438407.930168:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1c00/0x7a8dd0fcbb926235 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.930175:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1c00/0x7a8dd0fcbb926235 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438407.933235:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438407.935864:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749843200 00000100:00100000:1.0:1789438407.935880:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749843200 00000100:00100000:1.0:1789438407.935947:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 29 00000100:00100000:1.0:1789438407.935957:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+13:14437:x1876361749843200:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:1.0:1789438407.935979:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438407.935998:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb92624a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa67b expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.936061:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926251 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.936093:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926251 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.936104:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926251 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438407.936143:0:14402:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789438407.936148:0:14402:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789438407.936166:0:14402:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926251 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.936175:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926251 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.936200:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb92624a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa67b expref: 15 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.936218:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926251 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa67b expref: 14 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438407.936226:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9991d5872800) 00010000:00010000:1.0:1789438407.936229:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789438407.936232:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e0715000, rc 0) 00000100:00100000:1.0:1789438407.936314:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+14:14437:x1876361749843200:12345-192.168.206.9@tcp:101:bash.0 Request processed in 350us (3079us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438407.936322:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 29 00000100:00100000:0.0:1789438407.943508:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438407.944493:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749843456 00000100:00100000:2.0:1789438407.944506:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749843456 00000100:00100000:2.0:1789438407.944576:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 5 00000100:00100000:2.0:1789438407.944587:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff93a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+14:14437:x1876361749843456:12345-192.168.206.9@tcp:35:bash.0 00000100:00100000:2.0:1789438407.944987:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff93a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+15:14437:x1876361749843456:12345-192.168.206.9@tcp:35:bash.0 Request processed in 401us (1488us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789438407.944995:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 5 00000040:00080000:3.0:1789438407.992302:0:14433:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789438407.992824:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769753472:0@lo:400:kworker.0 00000100:00100000:0.0:1789438407.992898:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438407.992954:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769753984:0@lo:400:kworker.0 00000100:00100000:0.0:1789438407.992981:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438407.993005:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789438407.993012:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769753600:0@lo:400:kworker.0 00000100:00100000:0.0:1789438407.993031:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438407.993066:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769753984 00000100:00100000:0.0:1789438407.993073:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769753984 00000100:00080000:0.0:1789438407.993096:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789438407.993135:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789438407.993158:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769753984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438407.993208:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876361769753984:12345-0@lo:400:kworker.0 Request processed in 52us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438407.993216:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789438407.993258:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876361769753984:0@lo:400:kworker.0 00000100:00100000:2.0:1789438407.993875:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3666e65-cb7a-452a-a637-b1a251df2a46:3310:1876361769753344:0@lo:400:kworker.0 00000100:00100000:2.0:1789438407.993919:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438407.993953:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876361769753856:0@lo:400:kworker.0 00000100:00100000:2.0:1789438407.993978:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438407.993996:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789438407.994002:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876361769753728:0@lo:400:kworker.0 00000100:00100000:2.0:1789438407.994021:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438407.994385:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769753344 00000100:00100000:0.0:1789438407.994391:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769753344 00000100:00100000:0.0:1789438407.994435:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789438407.994454:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+19:3310:x1876361769753344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789438407.994505:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3666e65-cb7a-452a-a637-b1a251df2a46+19:3310:x1876361769753344:12345-0@lo:400:kworker.0 Request processed in 63us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438407.994511:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789438407.994536:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769753856 00000100:00100000:0.0:1789438407.994539:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769753856 00000100:00100000:1.0:1789438407.994541:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769753472 00000100:00100000:1.0:1789438407.994544:0:16426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769753472 00000100:00100000:1.0:1789438407.994568:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769753600 00000100:00100000:1.0:1789438407.994581:0:16426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769753600 00000100:00100000:1.0:1789438407.994691:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789438407.994698:0:16426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769753472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438407.994759:0:16426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769753472:12345-0@lo:400:kworker.0 Request processed in 61us (1862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438407.994766:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789438407.994778:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789438407.994784:0:16426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769753600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789438407.994794:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b3666e65-cb7a-452a-a637-b1a251df2a46:3310:1876361769753344:0@lo:400:kworker.0 00000100:00100000:1.0:1789438407.994809:0:16426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876361769753600:12345-0@lo:400:kworker.0 Request processed in 26us (1777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438407.994815:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789438407.994835:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769754112:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789438407.994849:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789438407.994853:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789438407.994856:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789438407.994870:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769753728 00000100:00100000:1.0:1789438407.994873:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769753728 00000100:00100000:2.0:1789438407.994874:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438407.994891:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789438407.994897:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876361769753856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789438407.994955:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769754112 00000100:00100000:3.0:1789438407.994961:0:15089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769754112 00000100:00100000:3.0:1789438407.994991:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789438407.994997:0:15089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769754112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789438407.995024:0:15089:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789438407.995056:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769753600:0@lo:400:kworker.0 00000100:00100000:0.0:1789438407.995294:0:14403:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789438407.995303:0:14403:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789438407.995409:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789438407.995417:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876361769753728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789438408.004015:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876361769753856:12345-0@lo:400:kworker.0 Request processed in 9110us (10028us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438408.004029:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789438408.004279:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876361769753856:0@lo:400:kworker.0 00000100:00100000:3.0:1789438408.010253:0:15089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876361769754112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 15242us (15364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438408.010282:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789438408.010417:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876361769754112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789438408.012224:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876361769753472:0@lo:400:kworker.0 00000100:00100000:0.0:1789438408.017072:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876361769753728:12345-0@lo:400:kworker.0 Request processed in 21637us (23031us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438408.017094:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789438408.020115:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876361769753728:0@lo:400:kworker.0 00000100:00100000:3.0:1789438408.040901:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438408.042055:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749843712 00000100:00100000:1.0:1789438408.042068:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749843712 00000100:00100000:1.0:1789438408.042153:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 30 00000100:00100000:1.0:1789438408.042163:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+15:14447:x1876361749843712:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438408.042202:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438408.042224:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb926258 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa682 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438408.042310:0:14401:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789438408.042417:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb926258 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa682 expref: 17 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.042431:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9991d5872700) 00010000:00010000:1.0:1789438408.042433:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789438408.042438:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb926258 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa682 expref: 17 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.042464:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e0715800, rc 0) 00000100:00100000:1.0:1789438408.042540:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+16:14447:x1876361749843712:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 378us (1648us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1789438408.042547:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 30 00000100:00100000:1.0:1789438408.050385:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438408.050484:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749843968 00000100:00100000:2.0:1789438408.050496:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749843968 00000100:00100000:2.0:1789438408.050559:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 6 00000100:00100000:2.0:1789438408.050570:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+16:14447:x1876361749843968:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:2.0:1789438408.050975:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+17:14447:x1876361749843968:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 405us (597us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789438408.050984:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 6 00000100:00100000:3.0:1789438408.118435:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438408.118689:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749844224 00000100:00100000:1.0:1789438408.118698:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749844224 00000100:00100000:1.0:1789438408.118782:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 31 00000100:00100000:1.0:1789438408.118792:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+17:14450:x1876361749844224:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789438408.118814:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438408.118834:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb926266 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa689 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.118945:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714c00/0x7a8dd0fcbb92626d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.118958:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714c00/0x7a8dd0fcbb92626d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.118970:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714c00/0x7a8dd0fcbb92626d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789438408.118981:0:14402:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789438408.119107:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb926266 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa689 expref: 20 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.119126:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714c00/0x7a8dd0fcbb92626d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa689 expref: 19 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.119135:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9991d5872800) 00010000:00010000:1.0:1789438408.119138:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789438408.119142:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e0714c00, rc 0) 00000100:00100000:1.0:1789438408.119208:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+19:14450:x1876361749844224:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 417us (783us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1789438408.119215:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 31 00000100:00100000:3.0:1789438408.123880:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438408.123917:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438408.124255:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749844352 00000100:00100000:1.0:1789438408.124266:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749844352 00000100:00100000:1.0:1789438408.124312:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 32 00000100:00100000:1.0:1789438408.124322:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+19:14450:x1876361749844352:12345-192.168.206.9@tcp:54:lfs.0 00010000:00010000:1.0:1789438408.124381:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715400/0x7a8dd0fcbb92627b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.124406:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715400/0x7a8dd0fcbb92627b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.124417:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715400/0x7a8dd0fcbb92627b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.124452:0:14401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715400/0x7a8dd0fcbb92627b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.124460:0:14401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715400/0x7a8dd0fcbb92627b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.124466:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715400/0x7a8dd0fcbb92627b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.124472:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0715400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438408.124476:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715400/0x7a8dd0fcbb92627b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.124483:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715400/0x7a8dd0fcbb92627b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.124493:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9991d5872800) 00010000:00010000:1.0:1789438408.124496:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789438408.124500:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715400/0x7a8dd0fcbb92627b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.124506:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715400/0x7a8dd0fcbb92627b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438408.124589:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+19:14450:x1876361749844352:12345-192.168.206.9@tcp:54:lfs.0 Request processed in 268us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438408.124603:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 32 00000100:00100000:1.0:1789438408.127499:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438408.127658:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749844480 00000100:00100000:2.0:1789438408.127684:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749844480 00000100:00100000:2.0:1789438408.127770:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00100000:2.0:1789438408.127782:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+19:2356:x1876361749844480:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789438408.127796:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438408.127819:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714c00/0x7a8dd0fcbb92626d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa689 expref: 19 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438408.127848:0:14387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9991d5872800) 00010000:00010000:2.0:1789438408.127853:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789438408.127905:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+18:2356:x1876361749844480:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 126us (3987us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438408.127913:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00100000:0.0:1789438408.129455:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749844736 00000100:00100000:0.0:1789438408.129466:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749844736 00000100:00100000:0.0:1789438408.129550:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:0.0:1789438408.129560:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+18:14450:x1876361749844736:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:0.0:1789438408.129883:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+19:14450:x1876361749844736:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 323us (2392us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789438408.129903:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:1.0:1789438408.388567:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438408.388753:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749844992 00000100:00100000:2.0:1789438408.388763:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749844992 00000100:00100000:2.0:1789438408.388827:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 33 00000100:00100000:2.0:1789438408.388838:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+19:14481:x1876361749844992:12345-192.168.206.9@tcp:101:cat.0 00010000:00010000:2.0:1789438408.388861:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438408.388880:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb926282 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa690 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438408.388974:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb926289 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438408.388988:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb926289 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438408.389010:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb926289 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438408.389040:0:14402:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789438408.389178:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb926282 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa690 expref: 22 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438408.389195:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb926289 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa690 expref: 21 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438408.389203:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9991d5872800) 00010000:00010000:2.0:1789438408.389205:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789438408.389208:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c69e1400, rc 0) 00000100:00100000:2.0:1789438408.390375:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+21:14481:x1876361749844992:12345-192.168.206.9@tcp:101:cat.0 Request processed in 1533us (1812us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789438408.390385:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 33 00000100:00100000:3.0:1789438408.399907:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438408.399987:0:16518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749845120 00000100:00100000:0.0:1789438408.399999:0:16518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749845120 00000100:00100000:0.0:1789438408.400067:0:16518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 1 00000100:00100000:0.0:1789438408.400076:0:16518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+21:2355:x1876361749845120:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789438408.400092:0:16518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438408.400115:0:16518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb926289 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa690 expref: 21 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438408.400132:0:16518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9991d5872800) 00010000:00010000:0.0:1789438408.400137:0:16518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789438408.400195:0:16518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+20:2355:x1876361749845120:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 119us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438408.400202:0:16518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 1 00000100:00100000:1.0:1789438408.407204:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438408.407309:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749845376 00000100:00100000:2.0:1789438408.407318:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749845376 00000100:00100000:2.0:1789438408.407383:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 8 00000100:00100000:2.0:1789438408.407393:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+20:14481:x1876361749845376:12345-192.168.206.9@tcp:35:cat.0 00000100:00100000:2.0:1789438408.407755:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+21:14481:x1876361749845376:12345-192.168.206.9@tcp:35:cat.0 Request processed in 361us (558us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1789438408.407763:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 8 00000100:00100000:1.0:1789438408.489831:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438408.489944:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749845632 00000100:00100000:0.0:1789438408.489954:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749845632 00000100:00100000:0.0:1789438408.490012:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 34 00000100:00100000:0.0:1789438408.490022:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+21:14487:x1876361749845632:12345-192.168.206.9@tcp:101:dd.0 00010000:00010000:0.0:1789438408.490044:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438408.490063:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb926297 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa697 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438408.490160:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb92629e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438408.490176:0:14401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1800/0x7a8dd0fcbb92623c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa674 expref: 22 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438408.490197:0:14401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926251 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa67b expref: 22 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438408.490205:0:14401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb92629e lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438408.490237:0:14401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926251 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa67b expref: 22 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438408.490250:0:14401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926251 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa67b expref: 22 pid: 14402 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438408.490263:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14401:1876361769754240:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438408.490359:0:14401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1800/0x7a8dd0fcbb92623c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa674 expref: 22 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438408.490380:0:14401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1800/0x7a8dd0fcbb92623c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa674 expref: 22 pid: 14401 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438408.490390:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14401:1876361769754368:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789438408.490414:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c6c69540 going to sleep for 11 seconds 00000100:00100000:3.0:1789438408.494175:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438408.494213:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438408.494321:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749845760 00000100:00100000:1.0:1789438408.494330:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749845760 00010000:00010000:1.0:1789438408.494383:0:14388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926251 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa67b expref: 23 pid: 14402 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438408.494416:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749845888 00000100:00100000:1.0:1789438408.494420:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749845888 00010000:00010000:1.0:1789438408.494432:0:14388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1800/0x7a8dd0fcbb92623c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa674 expref: 24 pid: 14401 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438408.494462:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 11 00000100:00100000:1.0:1789438408.494471:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c80c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+24:2355:x1876361749845760:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789438408.494486:0:14388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438408.494492:0:14388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926251 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa67b expref: 24 pid: 14402 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.494505:0:14388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926251 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa67b expref: 24 pid: 14402 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.494527:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9991d5872800) 00010000:00010000:1.0:1789438408.494532:0:14388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb92629e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.494557:0:14388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb92629e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.494574:0:14388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438408.494623:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c80c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+24:2355:x1876361749845760:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 152us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438408.494632:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 11 00000100:00100000:1.0:1789438408.494682:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 12 00000100:00100000:1.0:1789438408.494690:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+23:2355:x1876361749845888:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789438408.494699:0:14388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438408.494704:0:14388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1800/0x7a8dd0fcbb92623c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa674 expref: 23 pid: 14401 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.494743:0:14388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1800/0x7a8dd0fcbb92623c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa674 expref: 23 pid: 14401 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.494754:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9991d5872800) 00010000:00010000:1.0:1789438408.494757:0:14388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb92629e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.494765:0:14388:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb92629e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.494772:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb92629e lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.494789:0:14388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438408.494810:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+23:2355:x1876361749845888:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 121us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438408.494825:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 12 00010000:00010000:0.0:1789438408.495976:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715000/0x7a8dd0fcbb926251 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa67b expref: 22 pid: 14402 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438408.495997:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14401:1876361769754240:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438408.496028:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1800/0x7a8dd0fcbb92623c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa674 expref: 21 pid: 14401 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438408.496039:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14401:1876361769754368:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789438408.496059:0:14401:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb92629e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438408.496068:0:14401:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb92629e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438408.496073:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb92629e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438408.496093:0:14401:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789438408.497702:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb926297 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa697 expref: 22 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438408.497740:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62000/0x7a8dd0fcbb92629e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa697 expref: 21 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438408.497747:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9991d5872800) 00010000:00010000:0.0:1789438408.497750:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789438408.497753:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d62000, rc 0) 00000100:00100000:0.0:1789438408.497830:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+21:14487:x1876361749845632:12345-192.168.206.9@tcp:101:dd.0 Request processed in 7809us (8006us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1789438408.497850:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 34 00000100:00100000:3.0:1789438408.502288:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438408.506183:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749846144 00000100:00100000:0.0:1789438408.506197:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749846144 00000100:00100000:0.0:1789438408.506313:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 35 00000100:00100000:0.0:1789438408.506324:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+21:14487:x1876361749846144:12345-192.168.206.9@tcp:36:dd.0 00010000:00010000:0.0:1789438408.506657:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb9262ac lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438408.506675:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb9262ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438408.506687:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb9262ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789438408.506756:0:14403:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1789438408.506785:0:14403:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b8fdcfa reply state 00000000279873c8 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb9262ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438408.506793:0:14403:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789438408.507540:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+24:14487:x1876361749846144:12345-192.168.206.9@tcp:36:dd.0 Request processed in 1215us (5257us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1789438408.507548:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 35 00000020:00080000:0.0:1789438408.507553:0:14403:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789438408.512923:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00010000:00010000:3.0:1789438408.512993:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb9262ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438408.513006:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb9262ac lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438408.513014:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb9262ac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438408.513020:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63e00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438408.513026:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb9262ac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438408.513033:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb9262ac lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438408.513051:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9991d5872800) 00010000:00010000:3.0:1789438408.513055:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789438408.513061:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb9262ac lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438408.513086:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63e00/0x7a8dd0fcbb9262ac lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438408.513168:0:16630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749846272 00000100:00100000:1.0:1789438408.513180:0:16630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749846272 00000100:00100000:1.0:1789438408.513262:0:16630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 36 00000100:00100000:1.0:1789438408.513272:0:16630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+23:14487:x1876361749846272:12345-192.168.206.9@tcp:101:dd.0 00010000:00010000:1.0:1789438408.513294:0:16630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438408.513311:0:16630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715600/0x7a8dd0fcbb9262b3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa69e expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.513363:0:16630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715600/0x7a8dd0fcbb9262b3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa69e expref: 24 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.513383:0:16630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715600/0x7a8dd0fcbb9262b3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa69e expref: 24 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.513399:0:16630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9991d5872800) 00010000:00010000:1.0:1789438408.513401:0:16630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789438408.513404:0:16630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e0715600, rc 0) 00000100:00100000:1.0:1789438408.513469:0:16630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+24:14487:x1876361749846272:12345-192.168.206.9@tcp:101:dd.0 Request processed in 198us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438408.513476:0:16630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 36 00000100:00100000:2.0:1789438408.531054:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438408.531165:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749846528 00000100:00100000:1.0:1789438408.531175:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749846528 00000100:00100000:2.0:1789438408.531339:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 2 00000100:00100000:2.0:1789438408.531349:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+24:14487:x1876361749846528:12345-192.168.206.9@tcp:103:dd.0 00010000:00010000:2.0:1789438408.531379:0:14388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438408.531417:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715600/0x7a8dd0fcbb9262b3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa69e expref: 24 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438408.531435:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9991d5872800) 00010000:00010000:2.0:1789438408.531472:0:14388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789438408.532038:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+23:14487:x1876361749846528:12345-192.168.206.9@tcp:103:dd.0 Request processed in 687us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438408.532047:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 2 00000100:00100000:3.0:1789438408.534415:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438408.534550:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749846656 00000100:00100000:0.0:1789438408.534559:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749846656 00000100:00100000:0.0:1789438408.534617:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 37 00000100:00100000:0.0:1789438408.534626:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+23:14487:x1876361749846656:12345-192.168.206.9@tcp:58:dd.0 00010000:00010000:0.0:1789438408.534734:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9262ba lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438408.534750:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9262ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438408.534761:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9262ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789438408.535489:0:14403:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789438408.535629:0:14403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1789438408.535687:0:14403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1789438408.535804:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+23:14487:x1876361749846656:12345-192.168.206.9@tcp:58:dd.0 Request processed in 1176us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438408.535813:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 37 00000100:00100000:0.0:1789438408.539217:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438408.539341:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749846784 00000100:00100000:1.0:1789438408.539352:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749846784 00000100:00100000:1.0:1789438408.539587:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 38 00000100:00100000:1.0:1789438408.539598:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+23:14487:x1876361749846784:12345-192.168.206.9@tcp:101:dd.0 00010000:00010000:1.0:1789438408.539625:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438408.539646:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb9262c1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa6a5 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.539697:0:14401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9262ba lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.539910:0:14401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb9262c1 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6a5 expref: 24 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.539933:0:14401:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9262ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.539947:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb9262c1 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6a5 expref: 24 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.539961:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9991d5872800) 00010000:00010000:1.0:1789438408.539964:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789438408.539967:0:14401:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb9262c1 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6a5 expref: 24 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438408.539974:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e0714800, rc 0) 00000100:00100000:1.0:1789438408.540045:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+24:14487:x1876361749846784:12345-192.168.206.9@tcp:101:dd.0 Request processed in 449us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438408.540051:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 38 00010000:00010000:1.0:1789438408.630930:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438409.015076:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769754496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789438409.015147:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438409.015228:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769754496 00000100:00100000:0.0:1789438409.015236:0:15090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769754496 00000100:00100000:0.0:1789438409.015289:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1789438409.015293:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789438409.015297:0:15090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769754496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789438409.015341:0:15090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789438409.015394:0:15090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876361769754496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438409.015401:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789438409.015723:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876361769754496:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789438409.016513:0:14433:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789438409.016519:0:14433:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789438409.016566:0:14433:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789438409.016573:0:14433:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789438409.016671:0:14433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991facb6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14433:1876361769754624:192.168.206.9@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789438409.016772:0:14433:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f44a7000 going to sleep for 11 seconds 00000100:00100000:2.0:1789438409.021048:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438409.021761:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749846912 00000100:00100000:1.0:1789438409.021770:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749846912 00000100:00100000:1.0:1789438409.021857:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00100000:1.0:1789438409.021868:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+25:14488:x1876361749846912:12345-192.168.206.9@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789438409.021950:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+25:14488:x1876361749846912:12345-192.168.206.9@tcp:900:lhsmtool_posix.0 Request processed in 84us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438409.021957:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00080000:3.0:1789438409.022199:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789438409.023150:0:14433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991facb6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14433:1876361769754624:192.168.206.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789438409.028647:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438409.029253:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749847040 00000100:00100000:2.0:1789438409.029262:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749847040 00000100:00100000:2.0:1789438409.029518:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 39 00000100:00100000:2.0:1789438409.029530:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+24:14488:x1876361749847040:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789438409.029573:0:14403:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789438409.029680:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+24:14488:x1876361749847040:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 Request processed in 152us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438409.029687:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 39 00000100:00100000:3.0:1789438409.035460:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438409.035516:0:16630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749847168 00000100:00100000:0.0:1789438409.035526:0:16630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749847168 00000100:00100000:0.0:1789438409.035587:0:16630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 40 00000100:00100000:0.0:1789438409.035607:0:16630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+24:14488:x1876361749847168:12345-192.168.206.9@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789438409.035674:0:16630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb9262c8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.035728:0:16630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb9262c8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.035742:0:16630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb9262c8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.035795:0:16630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb9262cf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.035804:0:16630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb9262cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.035811:0:16630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb9262cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.035834:0:16630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9262d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.035842:0:16630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9262d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.035848:0:16630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9262d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789438409.035886:0:16630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789438409.035890:0:16630:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789438409.035906:0:16630:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9262d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.035917:0:16630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb9262c8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.035933:0:16630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb9262c8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.035940:0:16630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb9262c8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.035946:0:16630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63c00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438409.035951:0:16630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb9262c8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.035958:0:16630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb9262c8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.035971:0:16630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9991d5872000) 00010000:00010000:0.0:1789438409.035974:0:16630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438409.035978:0:16630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb9262c8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.035984:0:16630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb9262c8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.035997:0:16630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb9262cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.036003:0:16630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb9262cf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.036009:0:16630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb9262cf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.036015:0:16630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d62400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438409.036037:0:16630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb9262cf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.036044:0:16630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb9262cf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.036052:0:16630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9991c3ac2d00) 00010000:00010000:0.0:1789438409.036054:0:16630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438409.036056:0:16630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb9262cf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.036061:0:16630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb9262cf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.036077:0:16630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9262d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.036082:0:16630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9262d6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.036088:0:16630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9262d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.036093:0:16630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63000 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438409.036097:0:16630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9262d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.036102:0:16630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9262d6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.036109:0:16630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9991d5872800) 00010000:00010000:0.0:1789438409.036111:0:16630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438409.036121:0:16630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9262d6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.036127:0:16630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63000/0x7a8dd0fcbb9262d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438409.036312:0:16630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+24:14488:x1876361749847168:12345-192.168.206.9@tcp:34:lhsmtool_posix.0 Request processed in 707us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438409.036329:0:16630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 40 00000100:00100000:3.0:1789438409.062752:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438409.063102:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749847424 00000100:00100000:2.0:1789438409.063114:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749847424 00000100:00100000:2.0:1789438409.063176:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 41 00000100:00100000:2.0:1789438409.063188:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+24:14488:x1876361749847424:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789438409.063449:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438409.063471:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1000/0x7a8dd0fcbb9262dd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa6ac expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.063573:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0200/0x7a8dd0fcbb9262e4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.063589:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0200/0x7a8dd0fcbb9262e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.063601:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0200/0x7a8dd0fcbb9262e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438409.063613:0:14403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789438409.063702:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0200/0x7a8dd0fcbb9262e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.063746:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0200/0x7a8dd0fcbb9262e4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.063753:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0200/0x7a8dd0fcbb9262e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.063759:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c69e0200 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:2.0:1789438409.063764:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0200/0x7a8dd0fcbb9262e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.063771:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0200/0x7a8dd0fcbb9262e4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.063782:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9991d5872800) 00010000:00010000:2.0:1789438409.063790:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789438409.063795:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0200/0x7a8dd0fcbb9262e4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.063802:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0200/0x7a8dd0fcbb9262e4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.063846:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1000/0x7a8dd0fcbb9262dd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6ac expref: 26 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.063857:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9991d5872000) 00010000:00010000:2.0:1789438409.063859:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789438409.063863:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1000/0x7a8dd0fcbb9262dd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6ac expref: 26 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.063872:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c69e1000, rc 0) 00000100:00100000:2.0:1789438409.063932:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+25:14488:x1876361749847424:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 747us (1189us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1789438409.063939:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 41 00000100:00100000:2.0:1789438409.075992:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438409.077004:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749847552 00000100:00100000:1.0:1789438409.077015:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749847552 00000100:00100000:1.0:1789438409.077090:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 42 00000100:00100000:1.0:1789438409.077101:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+25:14488:x1876361749847552:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789438409.077137:0:14401:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789438409.077704:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+25:14488:x1876361749847552:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 Request processed in 602us (1720us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438409.077750:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 42 00000100:00100000:3.0:1789438409.091062:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438409.092372:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749847808 00000100:00100000:2.0:1789438409.092385:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749847808 00000100:00100000:2.0:1789438409.092460:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 43 00000100:00100000:2.0:1789438409.092472:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+25:14488:x1876361749847808:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789438409.092492:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438409.092515:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1000/0x7a8dd0fcbb9262f2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa6b3 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789438409.094238:0:14403:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:2.0:1789438409.094254:0:14403:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1789438409.094339:0:14403:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1789438409.094639:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0200/0x7a8dd0fcbb9262f9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.094656:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0200/0x7a8dd0fcbb9262f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.094668:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0200/0x7a8dd0fcbb9262f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.096077:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1000/0x7a8dd0fcbb9262f2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6b3 expref: 28 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.096103:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0200/0x7a8dd0fcbb9262f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6b3 expref: 27 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.096113:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:2.0:1789438409.096116:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789438409.096119:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c69e0200, rc 0) 00000100:00100000:2.0:1789438409.096189:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+27:14488:x1876361749847808:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 3720us (5136us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1789438409.096198:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 43 00000100:00100000:3.0:1789438409.102695:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438409.103018:0:16630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749848064 00000100:00100000:0.0:1789438409.103038:0:16630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749848064 00000100:00100000:0.0:1789438409.103084:0:16630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 44 00000100:00100000:0.0:1789438409.103092:0:16630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+27:14488:x1876361749848064:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789438409.103149:0:16630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789438409.103173:0:16630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0200/0x7a8dd0fcbb9262f9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6b3 expref: 27 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.103190:0:16630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9991d5872f00) 00010000:00010000:0.0:1789438409.103199:0:16630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789438409.103218:0:16630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb926307 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.103229:0:16630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb926307 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.103239:0:16630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb926307 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.103250:0:16630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb92630e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x289e099c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.103272:0:16630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb92630e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x289e099c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.103278:0:16630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb92630e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x289e099c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.103334:0:16630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb926307 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.103341:0:16630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb926307 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.103347:0:16630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb926307 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.103354:0:16630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d62400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438409.103358:0:16630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb926307 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.103365:0:16630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb926307 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.103373:0:16630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9991c3e2d500) 00010000:00010000:0.0:1789438409.103376:0:16630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438409.103379:0:16630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb926307 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.103385:0:16630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62400/0x7a8dd0fcbb926307 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.103393:0:16630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb92630e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x289e099c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.103404:0:16630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb92630e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x289e099c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.103410:0:16630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb92630e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x289e099c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.103414:0:16630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63c00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:0.0:1789438409.103417:0:16630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb92630e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x289e099c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.103424:0:16630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb92630e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x289e099c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.103430:0:16630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x289e099c (ffff9991c3ac2d00) 00010000:00010000:0.0:1789438409.103432:0:16630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789438409.103443:0:16630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb92630e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x289e099c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.103450:0:16630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb92630e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x289e099c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438409.103656:0:16630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+26:14488:x1876361749848064:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 563us (967us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789438409.103664:0:16630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 44 00000100:00100000:0.0:1789438409.106526:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438409.106624:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749848192 00000100:00100000:2.0:1789438409.106633:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749848192 00000100:00100000:2.0:1789438409.106689:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 45 00000100:00100000:2.0:1789438409.106700:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+26:14488:x1876361749848192:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789438409.106752:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438409.106774:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1000/0x7a8dd0fcbb926315 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa6ba expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.106829:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0a00/0x7a8dd0fcbb92631c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.106842:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0a00/0x7a8dd0fcbb92631c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.106853:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0a00/0x7a8dd0fcbb92631c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.106943:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1000/0x7a8dd0fcbb926315 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6ba expref: 28 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.106963:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0a00/0x7a8dd0fcbb92631c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6ba expref: 27 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.106970:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9991d5872b00) 00010000:00010000:2.0:1789438409.106973:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789438409.106977:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c69e0a00, rc 0) 00000100:00100000:2.0:1789438409.107035:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+27:14488:x1876361749848192:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 336us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438409.107042:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 45 00000100:00100000:1.0:1789438409.110528:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438409.110612:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749848448 00000100:00100000:0.0:1789438409.110622:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749848448 00000100:00100000:0.0:1789438409.110679:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 46 00000100:00100000:0.0:1789438409.110688:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+27:14488:x1876361749848448:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789438409.110823:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb926323 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.110840:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb926323 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.110852:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb926323 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789438409.111164:0:14401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1789438409.111174:0:14401:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 461376465401ns, next at 462376463145ns, rc = 0 00000004:00010000:0.0:1789438409.111256:0:14401:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000032abd410 reply state 000000006e7f69ed transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb926323 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438409.111266:0:14401:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789438409.111353:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+29:14488:x1876361749848448:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 664us (833us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1789438409.111361:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 46 00010000:00010000:1.0:1789438409.115519:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb926323 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.115537:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb926323 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.115544:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb926323 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.115550:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63c00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:1.0:1789438409.115555:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb926323 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.115575:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb926323 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.115606:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9991d5872b00) 00010000:00010000:1.0:1789438409.115609:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789438409.115615:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb926323 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.115621:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d63c00/0x7a8dd0fcbb926323 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438409.118018:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438409.118110:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749848576 00000100:00100000:2.0:1789438409.118119:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749848576 00000100:00100000:2.0:1789438409.118178:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 47 00000100:00100000:2.0:1789438409.118188:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+28:14488:x1876361749848576:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789438409.118211:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438409.118240:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1000/0x7a8dd0fcbb92632a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa6c1 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.118331:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1000/0x7a8dd0fcbb92632a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6c1 expref: 29 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.118345:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1000/0x7a8dd0fcbb92632a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6c1 expref: 29 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.118364:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9991d5872b00) 00010000:00010000:2.0:1789438409.118372:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789438409.118377:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c69e1000, rc 0) 00000100:00100000:2.0:1789438409.118447:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+29:14488:x1876361749848576:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 251us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438409.118454:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 47 00000100:00100000:3.0:1789438409.123193:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438409.123302:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749848704 00000100:00100000:1.0:1789438409.123311:0:16426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749848704 00000100:00100000:1.0:1789438409.123403:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 12 00000100:00100000:1.0:1789438409.123413:0:16426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+5:2354:x1876361749848704:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789438409.123802:0:16426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+6:2354:x1876361749848704:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 Request processed in 390us (617us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789438409.123811:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 12 00000100:00080000:3.0:1789438409.124611:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789438409.128649:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438409.128751:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749848960 00000100:00100000:2.0:1789438409.128761:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749848960 00000100:00100000:2.0:1789438409.128819:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:2.0:1789438409.128829:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+29:14488:x1876361749848960:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789438409.129052:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+30:14488:x1876361749848960:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 Request processed in 224us (411us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1789438409.129059:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:0.0:1789438409.131804:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438409.132096:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749849216 00000100:00100000:1.0:1789438409.132105:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749849216 00000100:00100000:1.0:1789438409.132166:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 48 00000100:00100000:1.0:1789438409.132176:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+30:14488:x1876361749849216:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789438409.132291:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+30:14488:x1876361749849216:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 116us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438409.132300:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 48 00000100:00100000:3.0:1789438409.135820:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438409.136016:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749849344 00000100:00100000:2.0:1789438409.136027:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749849344 00000100:00100000:2.0:1789438409.136087:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 49 00000100:00100000:2.0:1789438409.136097:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+30:14488:x1876361749849344:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789438409.136116:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789438409.136147:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb926331 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa6c8 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.136212:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb926338 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.136226:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb926338 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.136239:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb926338 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789438409.136271:0:14402:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789438409.136303:0:14402:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb926338 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.136340:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb926331 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6c8 expref: 32 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.136358:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb926338 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6c8 expref: 31 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.136549:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9991d5872b00) 00010000:00010000:2.0:1789438409.136553:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789438409.136556:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991c69e1400, rc 0) 00000100:00100000:2.0:1789438409.136616:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+31:14488:x1876361749849344:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 520us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438409.136623:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 49 00000100:00100000:3.0:1789438409.139801:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438409.140203:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749849472 00000100:00100000:2.0:1789438409.140213:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749849472 00000100:00100000:1.0:1789438409.140547:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:1.0:1789438409.140560:0:15085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+6:2353:x1876361749849472:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789438409.140584:0:15085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789438409.140604:0:15085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009778bcfa/0x7a8dd0fcbb92633f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa6cf expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789438409.140631:0:15085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa8a9c8, blocks: 0x1 00010000:00010000:1.0:1789438409.140662:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1789438409.140667:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438409.140676:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009778bcfa/0x7a8dd0fcbb92633f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6cf expref: 7 pid: 15085 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.140696:0:15085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009778bcfa/0x7a8dd0fcbb92633f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6cf expref: 7 pid: 15085 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.140730:0:15085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991e0714400, rc 0) 00000100:00100000:1.0:1789438409.140792:0:15085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+7:2353:x1876361749849472:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 236us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438409.140800:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:3.0:1789438409.143953:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438409.144288:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749849728 00000100:00100000:1.0:1789438409.144297:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749849728 00000100:00100000:1.0:1789438409.144360:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 50 00000100:00100000:1.0:1789438409.144379:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+31:14488:x1876361749849728:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789438409.144691:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+31:14488:x1876361749849728:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 322us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438409.144699:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 50 00000100:00100000:2.0:1789438409.147727:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789438409.147817:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749849856 00000100:00100000:0.0:1789438409.147827:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749849856 00000100:00100000:0.0:1789438409.148006:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 51 00000100:00100000:0.0:1789438409.148016:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+31:14488:x1876361749849856:12345-192.168.206.9@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789438409.197106:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:2.0:1789438409.197118:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1789438409.197153:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:2.0:1789438409.197162:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:2.0:1789438409.197181:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1789438409.197418:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769754752:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789438409.197490:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789438409.197661:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769754752 00000100:00100000:0.0:1789438409.197669:0:16426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769754752 00000100:00100000:0.0:1789438409.197743:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789438409.197753:0:16426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876361769754752:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789438409.197892:0:16426:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789438409.197906:0:16426:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1789438409.197909:0:16426:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789438409.197911:0:16426:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789438408 -> 1789438408 00002000:00010000:0.0:1789438409.197913:0:16426:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789438409.197953:0:16426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1876361769754752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 202us (463us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1789438409.197960:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1789438409.198147:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789438409.198185:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9991d06b1880/2, rc 0, transno 8589934595 00000100:00100000:2.0:1789438409.198191:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876361769754752:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789438409.198338:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+14:14488:x1876361749849856:12345-192.168.206.9@tcp:44:lhsmtool_posix.0 Request processed in 50320us (50633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438409.198353:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 51 00000100:00100000:0.0:1789438409.201768:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438409.201889:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749849984 00000100:00100000:1.0:1789438409.201899:0:15085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749849984 00000100:00100000:1.0:1789438409.201955:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:1.0:1789438409.201965:0:15085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+7:2353:x1876361749849984:12345-192.168.206.9@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789438409.202065:0:15085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+7:2353:x1876361749849984:12345-192.168.206.9@tcp:16:lhsmtool_posix.0 Request processed in 102us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438409.202073:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:2.0:1789438409.204384:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438409.204460:0:16630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749850240 00000100:00100000:1.0:1789438409.204469:0:16630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749850240 00000100:00100000:1.0:1789438409.204525:0:16630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 52 00000100:00100000:1.0:1789438409.204536:0:16630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+14:14488:x1876361749850240:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789438409.204593:0:16630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438409.204619:0:16630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1400/0x7a8dd0fcbb926338 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6c8 expref: 14 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.204638:0:16630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9991d5872b00) 00010000:00010000:1.0:1789438409.204643:0:16630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789438409.204671:0:16630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb926346 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.204684:0:16630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb926346 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.204694:0:16630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb926346 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789438409.204925:0:16630:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003925ae04 reply state 00000000c4778936 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb926346 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438409.204935:0:16630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789438409.205325:0:16630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+15:14488:x1876361749850240:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 789us (946us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1789438409.205334:0:16630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 52 00000100:00100000:2.0:1789438409.209653:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00010000:00010000:3.0:1789438409.209885:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb926346 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.209898:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb926346 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.209905:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb926346 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.209912:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0715800 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438409.209917:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb926346 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.209944:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb926346 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.209960:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9991d5872b00) 00010000:00010000:3.0:1789438409.209963:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789438409.209968:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb926346 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.209975:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715800/0x7a8dd0fcbb926346 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438409.210064:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749850368 00000100:00100000:0.0:1789438409.210073:0:16426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749850368 00000100:00100000:0.0:1789438409.210161:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:0.0:1789438409.210172:0:16426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+7:14488:x1876361749850368:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789438409.210189:0:16426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789438409.210205:0:16426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000748cdae4/0x7a8dd0fcbb92634d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x483b483084eaa6d6 expref: -99 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.210304:0:16426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009778bcfa/0x7a8dd0fcbb92633f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6cf expref: 8 pid: 15085 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.210314:0:16426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789438409.210318:0:16426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789438409.210323:0:16426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000748cdae4/0x7a8dd0fcbb92634d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6d6 expref: 8 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.210357:0:16426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009778bcfa/0x7a8dd0fcbb92633f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6cf expref: 8 pid: 15085 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.210463:0:16426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009778bcfa/0x7a8dd0fcbb92633f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6cf expref: 8 pid: 15085 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438409.210478:0:16426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d06b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16426:1876361769754880:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789438409.210606:0:16426:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c4e5aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789438409.215319:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438409.215967:0:16426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d06b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16426:1876361769754880:192.168.206.9@tcp:104: 00010000:00010000:1.0:1789438409.215999:0:16426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000748cdae4/0x7a8dd0fcbb92634d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6d6 expref: 8 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.216019:0:16426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9991f3d62600, rc 0) 00000100:00100000:1.0:1789438409.216082:0:16426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+8:14488:x1876361749850368:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 5912us (6528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438409.216092:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:2.0:1789438409.217338:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749850496 00000100:00100000:2.0:1789438409.217348:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749850496 00010000:00010000:2.0:1789438409.217396:0:14387:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009778bcfa/0x7a8dd0fcbb92633f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6cf expref: 8 pid: 15085 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438409.217482:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:2.0:1789438409.217492:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+8:2354:x1876361749850496:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789438409.217506:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438409.217528:0:14387:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009778bcfa/0x7a8dd0fcbb92633f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6cf expref: 8 pid: 15085 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.217543:0:14387:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009778bcfa/0x7a8dd0fcbb92633f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6cf expref: 8 pid: 15085 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.217596:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009778bcfa/0x7a8dd0fcbb92633f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6cf expref: 8 pid: 15085 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.217612:0:14387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789438409.217616:0:14387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789438409.217623:0:14387:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000748cdae4/0x7a8dd0fcbb92634d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6d6 expref: 7 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.217633:0:14387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000748cdae4/0x7a8dd0fcbb92634d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6d6 expref: 7 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.217668:0:14387:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000748cdae4/0x7a8dd0fcbb92634d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6d6 expref: 7 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438409.217682:0:14387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991facb7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14387:1876361769755008:192.168.206.9@tcp:105: 00000100:00100000:2.0:1789438409.217769:0:14387:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f44a73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789438409.221320:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438409.221676:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749850624 00000100:00100000:1.0:1789438409.221686:0:15085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749850624 00000100:00100000:1.0:1789438409.221761:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 17 00000100:00100000:1.0:1789438409.221772:0:15085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+8:2353:x1876361749850624:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789438409.221959:0:15085:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789438409.221963:0:15085:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789438408 00002000:00010000:1.0:1789438409.221966:0:15085:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789438407 00002000:00010000:1.0:1789438409.221968:0:15085:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789438408 -> 1789438408 00002000:00010000:1.0:1789438409.221970:0:15085:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789438409.222031:0:15085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+9:2353:x1876361749850624:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 Request processed in 260us (720us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789438409.222052:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 17 00000100:00100000:0.0:1789438409.224803:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438409.224895:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749850752 00000100:00100000:3.0:1789438409.224905:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749850752 00000100:00100000:3.0:1789438409.224956:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 18 00000100:00100000:3.0:1789438409.224965:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+9:2355:x1876361749850752:12345-192.168.206.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789438409.225003:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb926354 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.225023:0:15088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000748cdae4/0x7a8dd0fcbb92634d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6d6 expref: 9 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.225032:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438409.225037:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789438409.225042:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb926354 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.225078:0:15088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000748cdae4/0x7a8dd0fcbb92634d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6d6 expref: 9 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.225111:0:15088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000748cdae4/0x7a8dd0fcbb92634d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6d6 expref: 9 pid: 16426 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438409.225127:0:15088:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991e06fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15088:1876361769755136:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789438409.225202:0:15088:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991e07f93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789438409.225962:0:14387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991facb7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14387:1876361769755008:192.168.206.9@tcp:105: 00010000:00010000:2.0:1789438409.225985:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789438409.226068:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+9:2354:x1876361749850496:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 8576us (10758us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438409.226077:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:2.0:1789438409.229641:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438409.229934:0:16518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749850880 00000100:00100000:1.0:1789438409.229943:0:16518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749850880 00010000:00010000:1.0:1789438409.229982:0:16518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000748cdae4/0x7a8dd0fcbb92634d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6d6 expref: 9 pid: 16426 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438409.230022:0:16518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 14 00000100:00100000:1.0:1789438409.230032:0:16518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+9:2353:x1876361749850880:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789438409.230045:0:16518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789438409.230069:0:16518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000748cdae4/0x7a8dd0fcbb92634d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6d6 expref: 9 pid: 16426 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.230084:0:16518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000748cdae4/0x7a8dd0fcbb92634d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6d6 expref: 9 pid: 16426 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.230109:0:16518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789438409.230114:0:16518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789438409.230121:0:16518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb926354 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.230132:0:16518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb926354 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.230153:0:16518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789438409.230202:0:16518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+9:2353:x1876361749850880:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 170us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789438409.230225:0:16518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 14 00010000:00010000:3.0:1789438409.230980:0:15088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000748cdae4/0x7a8dd0fcbb92634d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6d6 expref: 8 pid: 16426 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438409.230999:0:15088:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991e06fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15088:1876361769755136:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789438409.231021:0:15088:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb926354 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.231032:0:15088:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb926354 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.231041:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb926354 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.231065:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb926354 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.231074:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb926354 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.231096:0:15088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb926354 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.231104:0:15088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a54800 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:3.0:1789438409.231109:0:15088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb926354 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.231119:0:15088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb926354 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.231133:0:15088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb926354 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.231141:0:15088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6357179/0x7a8dd0fcbb926354 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438409.231208:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+7:2355:x1876361749850752:12345-192.168.206.9@tcp:1:lhsmtool_posix.0 Request processed in 6243us (6413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438409.231217:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 18 00000100:00100000:2.0:1789438409.234192:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438409.234295:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749851136 00000100:00100000:1.0:1789438409.234305:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749851136 00000100:00100000:1.0:1789438409.234465:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 53 00000100:00100000:1.0:1789438409.234476:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991facb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+14:14488:x1876361749851136:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789438409.234562:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715400/0x7a8dd0fcbb92635b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.234588:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715400/0x7a8dd0fcbb92635b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.234599:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715400/0x7a8dd0fcbb92635b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.235326:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714c00/0x7a8dd0fcbb926362 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.235343:0:14403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1000/0x7a8dd0fcbb92632a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6c1 expref: 15 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.235352:0:14403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714c00/0x7a8dd0fcbb926362 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.235468:0:14403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1000/0x7a8dd0fcbb92632a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6c1 expref: 15 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.235484:0:14403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1000/0x7a8dd0fcbb92632a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6c1 expref: 15 pid: 14402 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438409.235510:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14403:1876361769755264:192.168.206.9@tcp:104: 00000100:00100000:1.0:1789438409.235633:0:14403:0:(client.c:2716:ptlrpc_set_wait()) set ffff9990c2219b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789438409.238734:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438409.238802:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749851264 00000100:00100000:2.0:1789438409.238823:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749851264 00010000:00010000:2.0:1789438409.238874:0:14389:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1000/0x7a8dd0fcbb92632a lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6c1 expref: 16 pid: 14402 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438409.238908:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:2.0:1789438409.238918:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991e06fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+16:2353:x1876361749851264:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789438409.238930:0:14389:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789438409.238937:0:14389:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1000/0x7a8dd0fcbb92632a lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6c1 expref: 16 pid: 14402 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.238950:0:14389:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1000/0x7a8dd0fcbb92632a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6c1 expref: 16 pid: 14402 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.238970:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9991d5872b00) 00010000:00010000:2.0:1789438409.238977:0:14389:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714c00/0x7a8dd0fcbb926362 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.238986:0:14389:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714c00/0x7a8dd0fcbb926362 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.238994:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714c00/0x7a8dd0fcbb926362 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.239012:0:14389:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789438409.239114:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e1000/0x7a8dd0fcbb92632a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6c1 expref: 16 pid: 14402 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438409.239131:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14403:1876361769755264:192.168.206.9@tcp:104: 00010000:00010000:1.0:1789438409.239148:0:14403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714c00/0x7a8dd0fcbb926362 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.239157:0:14403:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714c00/0x7a8dd0fcbb926362 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.239163:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714c00/0x7a8dd0fcbb926362 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789438409.239327:0:14403:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1789438409.239484:0:14403:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1789438409.239528:0:14403:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1789438409.239612:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff86c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14403:1876361769755392:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789438409.239697:0:14403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789438409.239752:0:14403:0:(client.c:2716:ptlrpc_set_wait()) set ffff9990c2219f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789438409.240191:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991e06fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+18:2353:x1876361749851264:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 1272us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438409.240202:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:2.0:1789438409.240246:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769755392 00000100:00100000:2.0:1789438409.240251:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769755392 00000100:00100000:2.0:1789438409.240286:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789438409.240293:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14403:x1876361769755392:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789438409.241275:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14403:x1876361769755392:12345-0@lo:1000:mdt00_002.0 Request processed in 68us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438409.241287:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789438409.241344:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff86c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14403:1876361769755392:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1789438409.243064:0:14403:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1789438409.243318:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991ff93aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14403:1876361769755520:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789438409.243476:0:14403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789438409.243557:0:14403:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991f44a7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789438409.243687:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361769755520 00000100:00100000:0.0:1789438409.243695:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361769755520 00000100:00100000:0.0:1789438409.245933:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789438409.245948:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14403:x1876361769755520:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789438409.246200:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14403:x1876361769755520:12345-0@lo:1000:mdt00_002.0 Request processed in 257us (2724us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789438409.246208:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789438409.246341:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991ff93aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14403:1876361769755520:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1789438409.246395:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714c00/0x7a8dd0fcbb926362 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.246407:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714c00/0x7a8dd0fcbb926362 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.246422:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714c00/0x7a8dd0fcbb926362 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.246428:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0714c00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438409.246432:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714c00/0x7a8dd0fcbb926362 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.246450:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714c00/0x7a8dd0fcbb926362 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.246465:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9991d5872b00) 00010000:00010000:3.0:1789438409.246468:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789438409.246473:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714c00/0x7a8dd0fcbb926362 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.246480:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714c00/0x7a8dd0fcbb926362 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.246513:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9262ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.246520:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9262ba lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.246525:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9262ba lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.246530:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d62c00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438409.246533:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9262ba lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.246548:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9262ba lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.246557:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9991d5872800) 00010000:00010000:3.0:1789438409.246688:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789438409.246696:0:14403:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb9262c1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6a5 expref: 18 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.246741:0:14403:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb9262c1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6a5 expref: 18 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.246751:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb9262c1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6a5 expref: 18 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.246811:0:14403:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0714800/0x7a8dd0fcbb9262c1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0x483b483084eaa6a5 expref: 18 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438409.246825:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9991d04b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14403:1876361769755648:192.168.206.9@tcp:105: 00000100:00100000:3.0:1789438409.246900:0:14403:0:(client.c:2716:ptlrpc_set_wait()) set ffff9991c1377840 going to sleep for 11 seconds 00000100:00100000:0.0:1789438409.249654:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438409.249775:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9991d04b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14403:1876361769755648:192.168.206.9@tcp:105: 00010000:00010000:3.0:1789438409.249805:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9262ba lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.249816:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991f3d62c00/0x7a8dd0fcbb9262ba lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.249849:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb926369 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.249875:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb926369 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.249887:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb926369 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.249898:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb926369 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.249904:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb926369 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.249911:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb926369 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.249917:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55a00 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438409.249921:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb926369 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.249928:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb926369 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.249939:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9991d5872800) 00010000:00010000:3.0:1789438409.249942:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789438409.249945:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb926369 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.249951:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c2a55a00/0x7a8dd0fcbb926369 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.249963:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715400/0x7a8dd0fcbb92635b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.249976:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715400/0x7a8dd0fcbb92635b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.249982:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715400/0x7a8dd0fcbb92635b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.249987:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0715400 already unused, calling callback (ffffffffc1f7c4f0) 00010000:00010000:3.0:1789438409.249990:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715400/0x7a8dd0fcbb92635b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.249997:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715400/0x7a8dd0fcbb92635b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.250005:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9991d5872800) 00010000:00010000:3.0:1789438409.250007:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789438409.250010:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715400/0x7a8dd0fcbb92635b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.250015:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991e0715400/0x7a8dd0fcbb92635b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789438409.250224:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991facb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+18:14488:x1876361749851136:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 15749us (16040us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1789438409.250234:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 53 00000020:00080000:3.0:1789438409.250240:0:14403:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789438409.250829:0:14433:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789438409.250834:0:14433:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789438409.250861:0:14433:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789438409.250868:0:14433:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789438409.252875:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438409.253972:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749851392 00000100:00100000:2.0:1789438409.253984:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749851392 00000100:00100000:2.0:1789438409.254025:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749851648 00000100:00100000:2.0:1789438409.254029:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749851648 00000100:00100000:2.0:1789438409.254046:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:2.0:1789438409.254055:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c8106c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+19:14487:x1876361749851392:12345-192.168.206.9@tcp:49:dd.0 00000100:00100000:2.0:1789438409.254183:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c8106c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+19:14487:x1876361749851392:12345-192.168.206.9@tcp:49:dd.0 Request processed in 127us (4536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789438409.254190:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:2.0:1789438409.254232:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 11 00000100:00100000:2.0:1789438409.254240:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+18:14488:x1876361749851648:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789438409.258927:0:14405:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789438409.259039:0:14405:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1789438409.259103:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb926370 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.259121:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb926370 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.259142:0:14405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb926370 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.259152:0:14405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb926370 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.259158:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb926370 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.259165:0:14405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb926370 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.259189:0:14405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789438409.259294:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+20:14488:x1876361749851648:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 Request processed in 5051us (6424us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1789438409.259304:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 11 00000020:00080000:2.0:1789438409.259321:0:14405:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789438409.259472:0:14391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789438409.259479:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb926370 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.259487:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c69e0800 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:3.0:1789438409.259498:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb926370 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.259506:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb926370 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.259518:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9991d5872b00) 00010000:00010000:3.0:1789438409.259521:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789438409.259526:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb926370 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.259533:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9991c69e0800/0x7a8dd0fcbb926370 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.259545:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438409.259547:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789438409.259549:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789438409.379983:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789438409.380117:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749851904 00000100:00100000:3.0:1789438409.380132:0:15091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749851904 00000100:00100000:3.0:1789438409.380196:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00100000:3.0:1789438409.380204:0:15091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+7:2356:x1876361749851904:12345-192.168.206.9@tcp:4:dd.0 00002000:00010000:3.0:1789438409.380249:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa8a9c8, atime: 0x6aa8a9c7, ctime: 0x6aa8a9c8, blocks: 0x1 00010000:00010000:3.0:1789438409.380258:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ddd2e62/0x7a8dd0fcbb926377 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.380272:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1789438409.380276:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789438409.380282:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ddd2e62/0x7a8dd0fcbb926377 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789438409.380305:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ddd2e62/0x7a8dd0fcbb926377 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438409.382775:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438409.383288:0:15093:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789438409.383299:0:15093:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1789438409.383647:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789438409.383725:0:15092:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789438409.383740:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749852032 00000100:00100000:2.0:1789438409.383748:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749852032 00000100:00100000:2.0:1789438409.383793:0:15092:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789438409.383955:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749851776 00000100:00100000:2.0:1789438409.384159:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749851776 00000100:00100000:0.0:1789438409.384669:0:16633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 1 00000100:00100000:0.0:1789438409.384681:0:16633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+10:2355:x1876361749852032:12345-192.168.206.9@tcp:4:dd.0 00010000:00010000:0.0:1789438409.384908:0:16633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022926216/0x7a8dd0fcbb92637e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.384926:0:16633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789438409.384930:0:16633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789438409.384937:0:16633:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022926216/0x7a8dd0fcbb92637e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.384952:0:16633:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022926216/0x7a8dd0fcbb92637e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789438409.449265:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:0.0:1789438409.449286:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:2.0:1789438409.453701:0:15091:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:2.0:1789438409.453736:0:15091:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1789438408 -> 1789438409 00002000:00010000:2.0:1789438409.453739:0:15091:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4099 00010000:00010000:2.0:1789438409.453755:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ddd2e62/0x7a8dd0fcbb926377 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.453790:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ddd2e62/0x7a8dd0fcbb926377 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.453798:0:15091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ddd2e62/0x7a8dd0fcbb926377 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.453805:0:15091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c2a55a00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:2.0:1789438409.453809:0:15091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ddd2e62/0x7a8dd0fcbb926377 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.453818:0:15091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ddd2e62/0x7a8dd0fcbb926377 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.453837:0:15091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ddd2e62/0x7a8dd0fcbb926377 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.453844:0:15091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ddd2e62/0x7a8dd0fcbb926377 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438409.453933:0:15091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+10:2356:x1876361749851904:12345-192.168.206.9@tcp:4:dd.0 Request processed in 73725us (73960us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1789438409.453941:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00100000:2.0:1789438409.453972:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 2 00000100:00100000:2.0:1789438409.453982:0:15091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991d06b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+9:2356:x1876361749851776:12345-192.168.206.9@tcp:4:dd.0 00010000:00010000:2.0:1789438409.454011:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd70fa62/0x7a8dd0fcbb926385 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.454028:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789438409.454032:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789438409.454093:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd70fa62/0x7a8dd0fcbb926385 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.454106:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd70fa62/0x7a8dd0fcbb926385 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789438409.527324:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:1.0:1789438409.531262:0:16633:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4099 -> 4103 00010000:00010000:1.0:1789438409.531284:0:16633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022926216/0x7a8dd0fcbb92637e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.531314:0:16633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022926216/0x7a8dd0fcbb92637e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.531324:0:16633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022926216/0x7a8dd0fcbb92637e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.531331:0:16633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63c00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:1.0:1789438409.531335:0:16633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022926216/0x7a8dd0fcbb92637e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.531344:0:16633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022926216/0x7a8dd0fcbb92637e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.531702:0:16633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022926216/0x7a8dd0fcbb92637e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.531741:0:16633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022926216/0x7a8dd0fcbb92637e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438409.534185:0:16633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+9:2355:x1876361749852032:12345-192.168.206.9@tcp:4:dd.0 Request processed in 149494us (151408us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789438409.534205:0:16633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 1 00000100:00100000:1.0:1789438409.548910:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438409.548945:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438409.548967:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438409.549000:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438409.549046:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438409.549072:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749852160 00000100:00100000:1.0:1789438409.549082:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749852160 00000100:00100000:1.0:1789438409.549133:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749852288 00000100:00100000:1.0:1789438409.549136:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749852288 00000100:00100000:1.0:1789438409.549167:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749852544 00000100:00100000:1.0:1789438409.549170:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749852544 00000100:00100000:1.0:1789438409.549184:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749852416 00000100:00100000:1.0:1789438409.549187:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749852416 00000100:00100000:1.0:1789438409.549199:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749852672 00000100:00100000:1.0:1789438409.549202:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749852672 00000100:00100000:1.0:1789438409.549220:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 3 00000100:00100000:1.0:1789438409.549231:0:15092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+13:2353:x1876361749852160:12345-192.168.206.9@tcp:4:dd.0 00010000:00010000:1.0:1789438409.549269:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000223fad38/0x7a8dd0fcbb92638c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.549300:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438409.549305:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789438409.549313:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000223fad38/0x7a8dd0fcbb92638c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.549330:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000223fad38/0x7a8dd0fcbb92638c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789438409.585737:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1789438409.585904:0:15091:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:2.0:1789438409.585909:0:15091:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:2.0:1789438409.585924:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd70fa62/0x7a8dd0fcbb926385 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.585937:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd70fa62/0x7a8dd0fcbb926385 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.585946:0:15091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd70fa62/0x7a8dd0fcbb926385 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.585953:0:15091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c69e1200 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:2.0:1789438409.585958:0:15091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd70fa62/0x7a8dd0fcbb926385 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.586058:0:15091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd70fa62/0x7a8dd0fcbb926385 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.586097:0:15091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd70fa62/0x7a8dd0fcbb926385 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.586104:0:15091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd70fa62/0x7a8dd0fcbb926385 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438409.586191:0:15091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991d06b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+13:2356:x1876361749851776:12345-192.168.206.9@tcp:4:dd.0 Request processed in 132207us (202542us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789438409.586200:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 2 00000100:00100000:2.0:1789438409.586228:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:2.0:1789438409.586239:0:15091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+12:2355:x1876361749852288:12345-192.168.206.9@tcp:4:dd.0 00010000:00010000:2.0:1789438409.586279:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000853bc0a1/0x7a8dd0fcbb926393 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.586290:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789438409.586294:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789438409.586300:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000853bc0a1/0x7a8dd0fcbb926393 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.586311:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000853bc0a1/0x7a8dd0fcbb926393 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789438409.618008:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:2.0:1789438409.624997:0:15092:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:2.0:1789438409.625007:0:15092:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:2.0:1789438409.625023:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000223fad38/0x7a8dd0fcbb92638c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.625050:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000223fad38/0x7a8dd0fcbb92638c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.625060:0:15092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000223fad38/0x7a8dd0fcbb92638c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.625069:0:15092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991e0714c00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:2.0:1789438409.625074:0:15092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000223fad38/0x7a8dd0fcbb92638c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.625085:0:15092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000223fad38/0x7a8dd0fcbb92638c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.625107:0:15092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000223fad38/0x7a8dd0fcbb92638c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.625116:0:15092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000223fad38/0x7a8dd0fcbb92638c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438409.625193:0:15092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+12:2353:x1876361749852160:12345-192.168.206.9@tcp:4:dd.0 Request processed in 75960us (76289us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789438409.625203:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 3 00000100:00100000:2.0:1789438409.625234:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 5 00000100:00100000:2.0:1789438409.625245:0:15092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+11:2355:x1876361749852544:12345-192.168.206.9@tcp:4:dd.0 00010000:00010000:2.0:1789438409.625273:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd70fa62/0x7a8dd0fcbb92639a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.625291:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789438409.625295:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789438409.625301:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd70fa62/0x7a8dd0fcbb92639a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.625315:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd70fa62/0x7a8dd0fcbb92639a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.656177:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789438409.661420:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:0.0:1789438409.665786:0:15091:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7340032 00002000:00010000:0.0:1789438409.665795:0:15091:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:0.0:1789438409.665809:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000853bc0a1/0x7a8dd0fcbb926393 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.665823:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000853bc0a1/0x7a8dd0fcbb926393 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.665832:0:15091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000853bc0a1/0x7a8dd0fcbb926393 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.665840:0:15091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c69e1c00 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:0.0:1789438409.665845:0:15091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000853bc0a1/0x7a8dd0fcbb926393 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.665873:0:15091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000853bc0a1/0x7a8dd0fcbb926393 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.665893:0:15091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000853bc0a1/0x7a8dd0fcbb926393 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.665902:0:15091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000853bc0a1/0x7a8dd0fcbb926393 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789438409.665999:0:15091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+11:2355:x1876361749852288:12345-192.168.206.9@tcp:4:dd.0 Request processed in 79759us (117049us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1789438409.666010:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:0.0:1789438409.666042:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 6 00000100:00100000:0.0:1789438409.666053:0:15091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+10:2355:x1876361749852416:12345-192.168.206.9@tcp:4:dd.0 00010000:00010000:0.0:1789438409.666082:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af47e669/0x7a8dd0fcbb9263a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.666095:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789438409.666099:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789438409.666106:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af47e669/0x7a8dd0fcbb9263a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789438409.666118:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af47e669/0x7a8dd0fcbb9263a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789438409.698975:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:2.0:1789438409.702107:0:15092:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:2.0:1789438409.702127:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd70fa62/0x7a8dd0fcbb92639a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.702141:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd70fa62/0x7a8dd0fcbb92639a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.702151:0:15092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd70fa62/0x7a8dd0fcbb92639a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.702160:0:15092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c69e1200 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:2.0:1789438409.702165:0:15092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd70fa62/0x7a8dd0fcbb92639a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.702175:0:15092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd70fa62/0x7a8dd0fcbb92639a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.702194:0:15092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd70fa62/0x7a8dd0fcbb92639a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.702215:0:15092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd70fa62/0x7a8dd0fcbb92639a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789438409.702299:0:15092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+10:2355:x1876361749852544:12345-192.168.206.9@tcp:4:dd.0 Request processed in 77053us (153327us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789438409.702308:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 5 00000100:00100000:2.0:1789438409.702338:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:2.0:1789438409.702349:0:15092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+9:2353:x1876361749852672:12345-192.168.206.9@tcp:4:dd.0 00010000:00010000:2.0:1789438409.702389:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb9263a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.702401:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789438409.702405:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789438409.702412:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb9263a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789438409.702424:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb9263a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789438409.735156:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:1.0:1789438409.739918:0:15091:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1789438409.739942:0:15091:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1789438409.739957:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af47e669/0x7a8dd0fcbb9263a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.739971:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af47e669/0x7a8dd0fcbb9263a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.739982:0:15091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af47e669/0x7a8dd0fcbb9263a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.739990:0:15091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991f3d63000 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:1.0:1789438409.739996:0:15091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af47e669/0x7a8dd0fcbb9263a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.740006:0:15091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af47e669/0x7a8dd0fcbb9263a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.740028:0:15091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af47e669/0x7a8dd0fcbb9263a1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.740037:0:15091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af47e669/0x7a8dd0fcbb9263a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438409.740122:0:15091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+9:2355:x1876361749852416:12345-192.168.206.9@tcp:4:dd.0 Request processed in 74067us (191117us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1789438409.740131:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 6 00010000:00010000:1.0:1789438409.773900:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb9263a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.773927:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb9263a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.773936:0:15092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb9263a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.773942:0:15092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9991c69e1800 already unused, calling callback (ffffffffc15218b0) 00010000:00010000:1.0:1789438409.773947:0:15092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb9263a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.773956:0:15092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb9263a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.773975:0:15092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb9263a8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789438409.773982:0:15092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026694463/0x7a8dd0fcbb9263a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789438409.774070:0:15092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+7:2353:x1876361749852672:12345-192.168.206.9@tcp:4:dd.0 Request processed in 71719us (225019us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1789438409.774079:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 7 00000001:00080000:3.0:1789438409.775037:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:3.0:1789438410.678917:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789438411.370626:0:16672:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1789438411.702940:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789438412.248121:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438412.248162:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438412.248207:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438412.248225:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438412.248241:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438412.248259:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438412.248279:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789438412.248300:0:16630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749853312 00000100:00100000:1.0:1789438412.248308:0:16630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749853312 00000100:00100000:0.0:1789438412.248454:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749853056 00000100:00100000:0.0:1789438412.248459:0:15085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749853056 00000100:00100000:0.0:1789438412.248483:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749853568 00000100:00100000:0.0:1789438412.248486:0:15085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749853568 00000100:00100000:0.0:1789438412.248498:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749853184 00000100:00100000:0.0:1789438412.248501:0:15085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749853184 00000100:00100000:0.0:1789438412.248512:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749853440 00000100:00100000:0.0:1789438412.248515:0:15085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749853440 00000100:00100000:0.0:1789438412.248531:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 19 00000100:00100000:0.0:1789438412.248541:0:15085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+5:2353:x1876361749853056:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789438412.248615:0:15085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+5:2353:x1876361749853056:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 76us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438412.248622:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 19 00000100:00100000:0.0:1789438412.248638:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 20 00000100:00100000:0.0:1789438412.248645:0:15085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfb3eacc-1e1b-434b-806a-250616f742cf+5:2353:x1876361749853568:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789438412.248667:0:15085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfb3eacc-1e1b-434b-806a-250616f742cf+5:2353:x1876361749853568:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 23us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438412.248673:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 20 00000100:00100000:0.0:1789438412.248684:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 21 00000100:00100000:0.0:1789438412.248691:0:15085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+5:2353:x1876361749853184:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789438412.248734:0:15085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+5:2353:x1876361749853184:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 43us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438412.248749:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 21 00000100:00100000:0.0:1789438412.248761:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 22 00000100:00100000:0.0:1789438412.248767:0:15085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfb3eacc-1e1b-434b-806a-250616f742cf+5:2353:x1876361749853440:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789438412.248792:0:15085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfb3eacc-1e1b-434b-806a-250616f742cf+5:2353:x1876361749853440:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 25us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438412.248797:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 22 00000100:00100000:0.0:1789438412.248820:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749852928 00000100:00100000:0.0:1789438412.248823:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749852928 00000100:00100000:0.0:1789438412.248859:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 28 00000100:00100000:0.0:1789438412.248867:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991ff86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfb3eacc-1e1b-434b-806a-250616f742cf+6:2353:x1876361749853312:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789438412.248902:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991ff86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfb3eacc-1e1b-434b-806a-250616f742cf+6:2353:x1876361749853312:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 35us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438412.248908:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 28 00000100:00100000:0.0:1789438412.248921:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 29 00000100:00100000:0.0:1789438412.248927:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991c3120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+20:2353:x1876361749852928:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789438412.248952:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991c3120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95f713a9-b8bf-4da8-a40a-409f87b2a8ff+20:2353:x1876361749852928:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 25us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789438412.248958:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 29 00000100:00080000:1.0:1789438412.249081:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789438412.249085:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789438412.249087:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789438412.249158:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876361749852800 00000100:00100000:3.0:1789438412.249163:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876361749852800 00000100:00100000:3.0:1789438412.249198:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 121 00000100:00100000:3.0:1789438412.249206:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9991f4407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de569208-d9a5-4940-b85b-d390a73b7b00+13:2353:x1876361749852800:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789438412.249234:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9991f4407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de569208-d9a5-4940-b85b-d390a73b7b00+13:2353:x1876361749852800:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 28us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789438412.249239:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 121 00010000:00010000:3.0:1789438412.726901:0:14391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29275 lines, 29275 kept, 0 dropped, 0 bad.